-- Logs begin at Thu 2022-05-19 05:41:07 UTC, end at Thu 2022-05-19 06:52:43 UTC. -- May 19 06:21:17.203881 dv-cinder-836996-22-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 19 06:21:17.218045 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 19 06:21:17.220214 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 06:21:17 2022] *** May 19 06:21:17.220214 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 06:21:17.220214 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 06:21:17.220214 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: nodename: dv-cinder-836996-22-iscsi May 19 06:21:17.220214 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: machine: x86_64 May 19 06:21:17.220214 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: clock source: unix May 19 06:21:17.220214 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: pcre jit disabled May 19 06:21:17.220214 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: detected number of CPU cores: 4 May 19 06:21:17.220214 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: current working directory: / May 19 06:21:17.220214 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: detected binary path: /usr/bin/uwsgi-core May 19 06:21:17.220214 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: your processes number limit is 47680 May 19 06:21:17.220214 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: your memory page size is 4096 bytes May 19 06:21:17.221656 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: detected max file descriptor number: 2048 May 19 06:21:17.221656 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: lock engine: pthread robust mutexes May 19 06:21:17.221656 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: thunder lock: enabled May 19 06:21:17.221656 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 19 06:21:17.221656 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 06:21:17.268019 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: Python main interpreter initialized at 0x55e3ef5dc9c0 May 19 06:21:17.268245 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: python threads support enabled May 19 06:21:17.268245 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: your server socket listen backlog is limited to 100 connections May 19 06:21:17.268245 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: your mercy for graceful operations on workers is 90 seconds May 19 06:21:17.268988 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: mapped 403077 bytes (393 KB) for 2 cores May 19 06:21:17.269088 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: *** Operational MODE: preforking *** May 19 06:21:17.269419 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: *** uWSGI is running in multiple interpreter mode *** May 19 06:21:17.269419 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: spawned uWSGI master process (pid: 102981) May 19 06:21:17.269684 dv-cinder-836996-22-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 19 06:21:17.270847 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: spawned uWSGI worker 1 (pid: 102982, cores: 1) May 19 06:21:17.270847 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: spawned uWSGI worker 2 (pid: 102983, cores: 1) May 19 06:21:17.270847 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 06:21:18.704046 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 06:21:18.880655 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 06:21:19.519660 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 06:21:19.519660 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: from cryptography.utils import int_from_bytes May 19 06:21:19.520087 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 06:21:19.520087 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: from cryptography.utils import int_from_bytes May 19 06:21:19.623575 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 06:21:19.623575 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: from cryptography.utils import int_from_bytes May 19 06:21:19.623966 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 06:21:19.623966 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: from cryptography.utils import int_from_bytes May 19 06:21:22.212722 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 06:21:22.213409 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 06:21:22.213516 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 06:21:22.213881 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 06:21:22.214141 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 06:21:22.214539 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.214868 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.215192 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.215494 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 06:21:22.215856 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.215948 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 06:21:22.216029 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.216129 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.216284 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 06:21:22.216463 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.216643 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 06:21:22.216780 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.216899 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 06:21:22.217113 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.217303 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.217411 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.217630 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.217723 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.217948 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.218112 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-22-iscsi {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.218263 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.218357 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.218594 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.218684 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.218905 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.218998 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.219224 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.219311 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.219541 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.219628 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.219863 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.219948 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.220121 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.220204 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.220432 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.220664 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.220783 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-22-iscsi {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.221794 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.221962 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.222239 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.222407 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.222537 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.222650 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.222887 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.223076 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.223187 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.223493 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.223615 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.223817 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.223969 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.224132 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.224417 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.224527 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.224761 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.225173 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-22-iscsi {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.225376 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.225517 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.225648 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.225832 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.226073 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.226169 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.226557 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.226728 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.226869 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.227103 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.227261 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.227470 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.227558 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.227796 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.228007 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.228096 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.228332 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.228419 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.228648 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.228763 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.228973 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.229061 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.229301 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.229461 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.229668 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.229755 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-22-iscsi {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.229979 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.230067 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.230291 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.230383 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.230612 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.230706 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.230920 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.231044 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.231226 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.231354 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.231481 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.231661 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.231791 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.231980 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.232114 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.232300 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.232435 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.232604 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.232760 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.232926 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.233090 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.233243 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.233353 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.233584 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.233677 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.233907 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.233993 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.234208 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.234301 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.234514 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.234599 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.234822 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.234907 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.235132 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.235237 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.235439 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.235527 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.235749 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.235858 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.236019 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.236126 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.236324 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.236424 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.236792 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.236909 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.236992 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.237088 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.237646 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.237771 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.237771 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.237926 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.238026 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.238117 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.238199 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.238330 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.238450 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.238585 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.238761 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.238894 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.239068 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.239242 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.239372 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.239565 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.239680 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.239873 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.239959 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.240192 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.240286 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.240515 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.240602 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.240823 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.240916 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.241131 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.241225 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.241464 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.241557 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.241779 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.241873 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.242082 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.242167 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.242393 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.242490 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.242647 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.242788 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.242950 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.243043 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.243259 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.243354 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.243578 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.243663 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.243885 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.243982 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.244190 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.244276 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.244497 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.244583 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.244798 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.244892 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.245105 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.245191 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.245436 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.245573 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.245738 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.245930 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.246042 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.246126 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.246347 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.246433 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.246658 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.246794 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.246917 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.247059 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.247186 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.247272 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.247489 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.247576 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.247803 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.247888 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.248106 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.248191 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.248412 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.248509 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.248714 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.248799 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.249010 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.249095 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.249332 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.249455 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.249634 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.249727 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.249936 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.250021 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.250238 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.250327 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.250538 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.250623 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.250837 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.250922 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.251138 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.251224 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.251438 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.251530 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.251739 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.251825 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.252043 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.252765 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.252902 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.253003 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.253175 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.253254 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.253504 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.253639 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.253810 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.253942 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.254110 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.254205 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.254414 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.254511 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.254713 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.254811 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.255013 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.255102 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.255315 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.255404 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.255620 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.255724 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.255920 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.256015 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.256225 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.256928 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.257024 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.257100 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.257100 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.257405 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.257497 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.257587 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.257668 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.257756 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.257835 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.257926 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.258014 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.258094 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.258301 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.258388 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.258603 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.258699 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.258908 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.259003 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.259207 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.259328 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.259507 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.259650 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.259805 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.260041 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.260141 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.260323 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.260423 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.260643 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.260729 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.260958 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.261057 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.261276 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.261412 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.261603 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.261688 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.261925 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.262023 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.262238 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.262314 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.262552 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.262626 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:21:22.262878 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.262953 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.263203 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.263290 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.263534 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.263616 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.263851 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.263926 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.264168 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.264244 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.264488 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.264564 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.264800 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.264876 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.265117 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.265201 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.265460 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.265555 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.265785 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.265871 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.266188 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.266377 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.266469 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.266550 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.266699 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.266796 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.267016 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.267178 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.267325 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.267431 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.267690 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.267875 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.268579 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.268675 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.268990 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.269164 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.269473 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.269702 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.269832 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.270026 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.270160 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.270349 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.270447 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.270684 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.270771 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.271013 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.271099 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.271327 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.271412 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.271672 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.271759 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.271988 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.272125 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.272305 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.272449 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.272652 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.272773 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.272971 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.273224 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.273331 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.273649 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.273747 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.273972 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.274058 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.274289 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.274374 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.274604 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.274891 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.274987 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.275215 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.275447 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.275541 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.275819 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.275978 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.276135 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.276284 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.276488 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.276631 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.276782 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.276918 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.277096 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.277226 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.277438 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.277673 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.277806 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.277999 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.278142 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.278600 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.278736 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.278930 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.279067 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.279243 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.279373 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.279559 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.279687 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.279874 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.280008 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.280189 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.280321 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.280482 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.280616 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.280818 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.280953 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.281132 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.281262 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.281453 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.281597 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.281783 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.281914 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.282091 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.282232 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.282400 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.282555 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.282721 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.282855 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.283036 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.283176 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.283350 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.283476 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.283818 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.283914 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.284098 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.284230 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.284410 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.284548 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.284724 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.284865 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.285035 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.285175 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.285375 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.285520 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.285693 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.285823 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.286006 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.286157 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.286307 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.286470 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.286628 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.286770 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.286940 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.287070 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.287244 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.287340 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.287559 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.287693 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.287860 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.288033 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.288180 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.288315 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.288459 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.288609 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.288750 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.288890 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.289048 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.289182 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.289379 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.289527 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.289690 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.289835 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.289996 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.290124 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.290302 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.290432 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.290614 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.290752 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.290930 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.291063 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.291235 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.291405 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.291536 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.291831 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.291973 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.292176 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.292331 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.292485 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.292718 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.292863 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.293157 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.293369 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.293503 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.293637 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.293816 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.294039 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.294171 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.294436 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.294577 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.294748 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.294887 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.295061 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.295208 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.295372 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.295507 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.295679 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.295821 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.295993 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.296177 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.296324 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.296595 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.296745 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.296915 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.297048 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.297240 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.297484 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.297615 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.297934 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.298022 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.298321 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.298413 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.298642 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.298736 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.299012 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.299138 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.299351 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.299445 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.299676 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.299833 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.300000 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.300256 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.300350 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.300746 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.300855 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.300946 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.301211 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.301318 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.301562 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.301697 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.301876 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.302142 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.302230 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.302495 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.302579 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.302816 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.302910 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.303129 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.303216 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.303454 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.303541 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.303767 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.303853 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.304089 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.304176 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.304394 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.304479 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.304708 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.304793 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.305029 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.305116 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.305367 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.305471 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.305684 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.305779 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.305998 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.306146 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.306318 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.306449 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.306621 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.306715 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.306932 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.307016 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.307243 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.307329 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.307551 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.307682 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.307858 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.307944 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.308170 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.308308 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.308483 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.308625 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.308793 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.308930 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.309101 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.309235 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.309433 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.309573 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.309744 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.309885 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.310053 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.310191 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.310361 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.310499 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.310667 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.310756 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.310978 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.311064 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.311300 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.311394 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.311615 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.311723 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.311938 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.312023 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.312259 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.312346 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.312567 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.312654 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.312872 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.312958 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.313198 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.313480 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.313641 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.313733 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.313834 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.313934 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.314141 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.314228 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.314449 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.314535 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.315305 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.315404 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.315617 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.315712 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.315924 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.316010 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.316243 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.316350 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.316563 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.316650 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.316875 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.316967 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.317191 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.317305 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.317527 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.317615 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.317837 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.317914 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.320585 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.320744 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.320858 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.320964 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.321067 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.321171 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.321367 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.321481 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.321586 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.321688 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.321803 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.321909 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.322021 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.322126 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.322126 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.322326 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.322326 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.322533 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.322646 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.322749 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.322851 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.322953 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.323056 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.323175 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.323289 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.323401 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.323488 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.323581 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.323581 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.323742 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.323821 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.323899 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.323977 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.324055 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.324133 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.324220 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.324299 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.324377 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.324455 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.324533 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.324619 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.324699 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.324777 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.324888 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.325071 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.325235 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.325466 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.325564 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.325815 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.325909 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.326180 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.326333 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.326490 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.326803 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.326892 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.327112 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.327200 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.327420 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.327507 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.327729 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.327817 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.328037 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.328129 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.328342 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.328454 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.329312 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.329446 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.329525 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.329611 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.329684 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.329752 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.329831 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.329901 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.329968 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.330034 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.330183 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.330292 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.331046 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.331196 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.331374 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.331460 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.331753 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.331997 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.332091 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.332303 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.332396 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.332611 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.332704 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.332937 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.333041 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.333426 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.333525 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.334090 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.334180 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.334259 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.334328 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.334328 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.334448 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.334573 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.334689 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.334883 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.334985 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.335211 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.335350 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.335519 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.335606 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.335826 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.335914 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.336134 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.336221 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.336436 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.336529 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.336746 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.336876 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.337047 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.337166 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.337381 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.337489 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.337683 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.337770 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.337985 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.338083 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.338286 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.338401 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.338677 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.338772 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.338889 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.338975 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.339186 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.339281 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.339496 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.339583 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.339796 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.339884 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.340101 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.340186 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.340408 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.340494 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.340707 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.340791 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.341006 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.341093 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.341332 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.341464 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.341643 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.341752 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.341948 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.342055 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.342266 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.342364 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.342575 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.342672 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.342883 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.342989 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.343189 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.343286 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.343499 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.343613 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.343807 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.343898 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.344109 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.344196 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.344411 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.344507 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.344710 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.344797 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.345016 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.345102 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.345346 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.345464 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.345645 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.345741 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.346470 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.346566 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.346785 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.346919 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.347095 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.347199 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.347432 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.347562 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.347732 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.347868 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.348020 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.348153 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.348324 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.348456 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.348635 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.348766 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.348939 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.349080 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.349241 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.349379 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.349599 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.349733 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.349865 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.350012 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.350150 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.350283 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.350422 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.350553 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.350720 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.350864 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.351002 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.351141 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.351315 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.351418 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.351616 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.351749 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.351914 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.352000 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.352212 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.352287 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.352517 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.352606 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.352823 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.352926 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.353125 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.353219 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.353478 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.353651 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.353778 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.353968 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.354079 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.354156 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.354378 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.354467 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.354685 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.354781 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.354985 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.355071 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.355284 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.355370 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.355589 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.355684 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.355912 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.356041 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.356225 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.356319 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.356525 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.356618 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.356828 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.356917 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.357139 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.357227 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.357458 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.357658 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.357806 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.357939 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.358072 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.358214 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.358348 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.358486 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.358619 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.358713 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.358902 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.359048 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.359207 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.359341 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.359507 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.359653 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.359824 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.359967 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.360127 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.360261 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.360425 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.360566 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.360725 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.360868 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.361025 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.361156 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.361386 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.361513 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.362253 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.362344 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.362598 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.362815 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.362902 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.363197 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.363316 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.363515 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.363603 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.363829 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.363945 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.364158 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.364262 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.364431 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.364533 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.364730 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.364816 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.365040 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.365137 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.365367 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.365510 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.366242 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.366385 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.366484 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.366566 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.366645 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.366724 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.366801 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.366879 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.367057 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.367206 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.367369 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.367481 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.367688 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.367788 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.367997 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.368095 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.368315 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.368412 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.368616 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.368713 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.368922 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.369020 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.369228 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.369361 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.369565 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.369662 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.369873 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.369970 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.370180 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.370278 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.370489 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.370600 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.370796 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.370893 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.371103 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.371200 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.371411 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.371516 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.371717 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.371814 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.372021 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.372118 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.372328 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.372436 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.372633 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.372730 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.372935 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.373031 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.373256 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.373392 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.373584 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.373673 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.373907 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.374017 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.374249 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.374347 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.374552 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.374649 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.374861 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.374949 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.375164 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.375310 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.375592 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.375682 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.375902 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.375999 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.376209 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.376299 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.376511 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.376601 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.376817 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.376915 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.377151 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.377754 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.377981 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.378065 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.378298 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.378409 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.378624 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.378713 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.378950 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.379066 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.379288 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.379393 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.379573 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.379665 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.379880 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.379968 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.380208 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.380312 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.380534 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.380622 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.380840 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.380936 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.381161 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.381262 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.381509 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.381599 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.381815 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.381902 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.382186 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.382285 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.382509 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.382608 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.382813 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.382903 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.383129 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.383216 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.383438 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.383535 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.383748 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.383838 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.384058 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.384159 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.384364 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.384523 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.384691 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.384833 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.384999 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.385139 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.385331 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.385501 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.385645 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.385825 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.385956 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.386147 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.386246 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.386452 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.386541 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.386762 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.386851 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.387070 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.387169 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.387390 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.387479 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.387709 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.387805 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.388071 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.388160 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.388394 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.388491 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.388696 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.388784 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.389018 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.389108 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.389367 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.389462 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.389660 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.389751 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.389966 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.390056 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.390270 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.390368 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.390611 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.390715 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.390917 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.391053 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.391238 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.391328 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.391570 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.391668 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.391878 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.391983 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.392191 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.392284 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.392499 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.392602 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.392888 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.393639 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.393767 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.393850 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.394015 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.394307 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.394399 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.394490 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.394614 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.394733 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.394971 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.395068 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.395281 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.395371 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.395583 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.395679 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.395885 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.395975 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.396202 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.396291 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.396504 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.396592 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.396810 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.396899 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.397117 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.397206 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.397447 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.397556 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.397765 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.397853 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.398065 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.398201 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.398385 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.398484 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.398690 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.398778 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.398990 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.399087 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.399291 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.399389 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.399595 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.399683 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.399929 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.400017 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.400229 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.400327 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.400544 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.400634 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.400868 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.400956 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.401193 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.401386 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.401524 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.401673 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.401840 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.401979 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.402204 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.402339 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.402476 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.402619 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.402764 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.402900 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.403069 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.403208 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.403633 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.403769 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.403937 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.404077 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.404244 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.404418 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.404552 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.404690 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.404827 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.404970 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.405107 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.405249 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.405434 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.405570 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.405727 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.405889 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.406026 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.406308 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.406445 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.406625 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.406763 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.406914 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.407050 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.407228 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.407365 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.407531 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.407669 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.407833 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.407982 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.408117 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.408258 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.408506 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.408760 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.408901 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.409040 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.409175 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.409360 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.409506 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.409717 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.409855 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.409999 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.410136 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.410270 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.410407 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.410580 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.410720 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.410920 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.411059 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.411243 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.411379 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.411559 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.411651 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.411875 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.411963 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.412189 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.412286 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.412508 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.412593 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.412820 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.412906 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.413132 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.413228 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.413464 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.413554 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.413777 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.413864 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.414088 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.414176 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.414399 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.414504 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.414714 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.414954 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.415051 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.415279 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.415366 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.415588 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.415683 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.415897 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.415997 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.416203 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.416290 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.416512 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.416598 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.416820 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.416915 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.417125 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.417213 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.417457 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.417566 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.417762 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.417851 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.418067 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.418251 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.418393 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.418526 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.418749 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.418923 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.419064 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.419239 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.419377 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.419579 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.419727 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.419908 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.420047 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.420227 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.420366 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.420537 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.420677 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.420855 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.421001 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.421185 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.421368 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.421510 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.421602 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.421817 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.421906 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.422126 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.422233 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.422433 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.422511 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.422737 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.422824 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.423044 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.423140 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.423353 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.423442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.423662 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.423776 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.424089 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.424190 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.424552 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.424634 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.425092 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.425245 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.425580 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.425688 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.425928 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.426068 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.426256 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.426700 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.426809 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.426883 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.427171 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.427273 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.427511 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.427658 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.427832 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.428112 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.428198 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.428450 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.428564 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.428764 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.429072 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.429308 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.429398 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.429709 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.429800 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.430021 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.430234 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.430322 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.430624 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.430716 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.430931 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.431142 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.431259 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.431570 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.431679 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.431876 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.432058 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.432184 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.432499 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.432585 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.432807 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.432942 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.433113 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.433419 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.433529 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.433737 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.433903 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.434049 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.434348 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.434435 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.434659 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.434802 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.434963 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.435276 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.435404 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.435582 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.435789 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.435884 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.436223 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.436320 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.436546 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.436675 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.436853 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.437120 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.437212 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.437488 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.437803 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.437889 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.438126 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.438325 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.438424 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.438737 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.438831 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.439084 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.439260 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.439400 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.440217 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.440615 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.440702 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.440962 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.441049 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.441318 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.441532 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.441743 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.441984 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.442082 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.442298 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.442505 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.442613 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.442926 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.443013 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.443253 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.443364 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.443571 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.443857 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.444038 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.444194 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.444421 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.444588 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.444790 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.444981 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.445154 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.445470 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.445651 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.445818 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.446028 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.446198 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.446349 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.446597 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.446760 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.446938 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.447149 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.447306 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.447584 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.447740 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.447890 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.448174 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.448349 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.448510 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.448723 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.448968 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.449122 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.449276 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.449486 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.449745 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.449900 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.450048 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.450321 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.450480 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.450692 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.450856 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.451018 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.451308 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.451462 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.451736 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.451891 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.452041 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.452337 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.452496 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.452675 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.452884 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.453056 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.453328 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.453481 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.453631 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.453930 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.454116 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.454266 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.454492 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.454650 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.454870 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.455035 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.455217 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.456082 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.456254 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.456416 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.456706 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.456883 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.457046 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.457321 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.457491 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.457663 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.457900 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.458071 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.458249 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.458455 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.458623 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.458853 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.459065 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.459231 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.459458 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.459611 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.459760 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.460055 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.460224 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.460373 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.460607 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.460764 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.460954 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.461166 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.461362 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.461574 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.461795 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.461952 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.462170 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.462353 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.462524 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.462841 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.463079 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.463250 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.463401 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.463677 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.463845 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.463994 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.464270 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.464425 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.464601 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.464854 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.465011 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.465234 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.465478 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.465630 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.465872 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.466036 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.466188 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.466488 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.466655 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.466805 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.467027 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.467227 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.467417 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.467607 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.467762 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.468049 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.468204 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.468366 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.468635 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.468796 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.468944 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.469195 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.469409 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.469574 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.469789 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.469958 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.470176 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.470338 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.470501 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.470800 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.470989 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.471235 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.471494 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.471653 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.471972 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.472128 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.472275 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.472516 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.472674 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.472906 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.473056 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.473205 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.473547 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.473703 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.473869 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.474106 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.474265 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.474464 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.474672 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.474829 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.475089 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.475253 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.475403 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.475730 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.475901 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.476062 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.476306 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.476481 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.476680 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.476875 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.477042 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.477354 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.477528 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.477704 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.477955 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.478112 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.478340 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.478492 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.478657 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.478949 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.479113 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.479262 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 06:21:22.479508 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.479949 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.480435 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.480860 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.481352 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.481861 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.482315 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.482750 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.483177 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.483608 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.484039 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.484475 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.484894 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.485366 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.485788 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.486222 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.486708 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.487174 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.487609 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.488036 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.488449 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.489205 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.489431 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.489840 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.490269 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.490681 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.491098 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.491516 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.491934 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.492347 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.492763 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.493181 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.493640 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.494059 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.494522 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.494940 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.495359 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.495797 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.496209 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.496628 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.497040 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.497535 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.497958 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.498373 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.498787 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.499231 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.499696 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.500125 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.500561 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.500979 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.501448 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.501866 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.502810 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.503250 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.503677 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.504093 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.504529 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.504957 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.505416 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.505846 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.506267 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.506685 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.507101 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.507536 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.507972 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.508386 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.508815 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.509238 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.509694 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.510114 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.510540 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.510976 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.511393 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.511809 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.512237 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.512653 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.513079 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.513545 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.514004 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.514444 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.514892 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.515321 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.515756 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.516192 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.516646 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.517066 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.517563 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.518620 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.519474 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.519758 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.520180 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:21:22.520527 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 06:21:22.539370 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO dbcounter [None req-ad6d9f2b-47d7-459d-884a-03988d2d2036 None None] Registered counter for database nova_api May 19 06:21:22.561079 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG oslo_db.sqlalchemy.engines [None req-ad6d9f2b-47d7-459d-884a-03988d2d2036 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102983) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 06:21:22.568323 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG dbcounter [-] [102983] Writer thread running {{(pid=102983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 06:21:22.582729 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO dbcounter [None req-a67955b9-c31f-4cb7-b0ae-d0bdcd7eafc6 None None] Registered counter for database nova_api May 19 06:21:22.604039 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG oslo_db.sqlalchemy.engines [None req-a67955b9-c31f-4cb7-b0ae-d0bdcd7eafc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102982) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 06:21:22.611467 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG dbcounter [-] [102982] Writer thread running {{(pid=102982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 06:21:22.626036 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.context [None req-ad6d9f2b-47d7-459d-884a-03988d2d2036 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3c468ea9-4daa-4cd8-93b7-4e256fd82cc9(cell1) {{(pid=102983) load_cells /opt/stack/nova/nova/context.py:464}} May 19 06:21:22.632405 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG oslo_concurrency.lockutils [None req-ad6d9f2b-47d7-459d-884a-03988d2d2036 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:21:22.634076 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG oslo_concurrency.lockutils [None req-ad6d9f2b-47d7-459d-884a-03988d2d2036 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:21:22.634904 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG oslo_concurrency.lockutils [None req-ad6d9f2b-47d7-459d-884a-03988d2d2036 None None] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:21:22.636897 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG oslo_concurrency.lockutils [None req-ad6d9f2b-47d7-459d-884a-03988d2d2036 None None] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:21:22.638968 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO dbcounter [None req-ad6d9f2b-47d7-459d-884a-03988d2d2036 None None] Registered counter for database nova_cell0 May 19 06:21:22.643906 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO dbcounter [None req-ad6d9f2b-47d7-459d-884a-03988d2d2036 None None] Registered counter for database nova_cell1 May 19 06:21:22.654906 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG oslo_db.sqlalchemy.engines [None req-ad6d9f2b-47d7-459d-884a-03988d2d2036 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102983) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 06:21:22.656207 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG oslo_db.sqlalchemy.engines [None req-ad6d9f2b-47d7-459d-884a-03988d2d2036 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102983) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 06:21:22.665505 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG dbcounter [-] [102983] Writer thread running {{(pid=102983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 06:21:22.666803 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG dbcounter [-] [102983] Writer thread running {{(pid=102983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 06:21:22.686326 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.context [None req-a67955b9-c31f-4cb7-b0ae-d0bdcd7eafc6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3c468ea9-4daa-4cd8-93b7-4e256fd82cc9(cell1) {{(pid=102982) load_cells /opt/stack/nova/nova/context.py:464}} May 19 06:21:22.692782 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG oslo_concurrency.lockutils [None req-a67955b9-c31f-4cb7-b0ae-d0bdcd7eafc6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:21:22.694528 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG oslo_concurrency.lockutils [None req-a67955b9-c31f-4cb7-b0ae-d0bdcd7eafc6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:21:22.695463 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG oslo_concurrency.lockutils [None req-a67955b9-c31f-4cb7-b0ae-d0bdcd7eafc6 None None] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:21:22.697651 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG oslo_concurrency.lockutils [None req-a67955b9-c31f-4cb7-b0ae-d0bdcd7eafc6 None None] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:21:22.699793 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO dbcounter [None req-a67955b9-c31f-4cb7-b0ae-d0bdcd7eafc6 None None] Registered counter for database nova_cell0 May 19 06:21:22.703945 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO dbcounter [None req-a67955b9-c31f-4cb7-b0ae-d0bdcd7eafc6 None None] Registered counter for database nova_cell1 May 19 06:21:22.711510 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG oslo_db.sqlalchemy.engines [None req-a67955b9-c31f-4cb7-b0ae-d0bdcd7eafc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102982) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 06:21:22.714667 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG oslo_db.sqlalchemy.engines [None req-a67955b9-c31f-4cb7-b0ae-d0bdcd7eafc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102982) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 06:21:22.717540 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG dbcounter [-] [102982] Writer thread running {{(pid=102982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 06:21:22.820782 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO dbcounter [None req-ad6d9f2b-47d7-459d-884a-03988d2d2036 None None] Registered counter for database nova_cell0 May 19 06:21:22.829350 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG oslo_db.sqlalchemy.engines [None req-ad6d9f2b-47d7-459d-884a-03988d2d2036 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102983) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 06:21:22.834033 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG dbcounter [-] [102983] Writer thread running {{(pid=102983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 06:21:22.864774 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG dbcounter [-] [102982] Writer thread running {{(pid=102982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 06:21:22.875198 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO dbcounter [None req-a67955b9-c31f-4cb7-b0ae-d0bdcd7eafc6 None None] Registered counter for database nova_cell0 May 19 06:21:22.887517 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG oslo_db.sqlalchemy.engines [None req-a67955b9-c31f-4cb7-b0ae-d0bdcd7eafc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102982) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 06:21:22.892367 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG dbcounter [-] [102982] Writer thread running {{(pid=102982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 06:21:23.188088 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: WARNING keystonemiddleware.auth_token [None req-ad6d9f2b-47d7-459d-884a-03988d2d2036 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 06:21:23.195824 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: WARNING keystonemiddleware.auth_token [None req-ad6d9f2b-47d7-459d-884a-03988d2d2036 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 06:21:23.225816 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: WARNING keystonemiddleware.auth_token [None req-a67955b9-c31f-4cb7-b0ae-d0bdcd7eafc6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 06:21:23.233673 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: WARNING keystonemiddleware.auth_token [None req-a67955b9-c31f-4cb7-b0ae-d0bdcd7eafc6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 06:21:23.554896 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: WARNING keystonemiddleware.auth_token [None req-ad6d9f2b-47d7-459d-884a-03988d2d2036 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 06:21:23.561053 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: WARNING keystonemiddleware.auth_token [None req-ad6d9f2b-47d7-459d-884a-03988d2d2036 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 06:21:23.566972 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e3ef5dc9c0 pid: 102983 (default app) May 19 06:21:23.569142 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-ad6d9f2b-47d7-459d-884a-03988d2d2036 None None] Calling method '>' {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:21:23.570436 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-ad6d9f2b-47d7-459d-884a-03988d2d2036 None None] 10.222.0.65 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001909 May 19 06:21:23.571215 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 788 bytes} [Thu May 19 06:21:23 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:21:23.587994 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: WARNING keystonemiddleware.auth_token [None req-a67955b9-c31f-4cb7-b0ae-d0bdcd7eafc6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 06:21:23.594269 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: WARNING keystonemiddleware.auth_token [None req-a67955b9-c31f-4cb7-b0ae-d0bdcd7eafc6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 06:21:23.600440 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e3ef5dc9c0 pid: 102982 (default app) May 19 06:22:48.800649 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-ad6d9f2b-47d7-459d-884a-03988d2d2036 None None] Calling method '>' {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:22:48.801759 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-ad6d9f2b-47d7-459d-884a-03988d2d2036 None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 19 06:22:48.802346 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 2/2] 10.222.0.65 () {54 vars in 930 bytes} [Thu May 19 06:22:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:22:48.814880 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG dbcounter [-] [102982] Writing DB stats nova_api:SELECT=3 {{(pid=102982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:22:48.815914 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG dbcounter [-] [102982] Writing DB stats nova_cell0:SELECT=3 {{(pid=102982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:22:48.816821 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG dbcounter [-] [102982] Writing DB stats nova_cell1:SELECT=3 {{(pid=102982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:22:48.817876 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG dbcounter [-] [102982] Writing DB stats nova_cell0:SELECT=3 {{(pid=102982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:22:49.358778 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-4dd0ec38-5684-4539-b4c9-0030f0eeb90e admin admin] Calling method '>' {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:22:49.395144 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-4dd0ec38-5684-4539-b4c9-0030f0eeb90e admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.585323 May 19 06:22:49.395839 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 1/3] 10.222.0.65 () {60 vars in 1291 bytes} [Thu May 19 06:22:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:22:51.918321 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-ad6d9f2b-47d7-459d-884a-03988d2d2036 None None] Calling method '>' {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:22:51.919267 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-ad6d9f2b-47d7-459d-884a-03988d2d2036 None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005944 May 19 06:22:51.919715 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 3/4] 10.222.0.65 () {54 vars in 930 bytes} [Thu May 19 06:22:51 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:22:52.011891 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-a91fffab-9e82-4d80-94b2-07032f5a8480 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "cirros256", "rxtx_factor": 1.0, "ram": 256, "id": "c1", "disk": 1}} {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:22:52.032778 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 06:22:52.032778 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: warnings.warn(msg) May 19 06:22:52.068218 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-a91fffab-9e82-4d80-94b2-07032f5a8480 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.137599 May 19 06:22:52.076019 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 2/5] 10.222.0.65 () {64 vars in 1282 bytes} [Thu May 19 06:22:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 06:22:52.303561 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-51fd67d1-5129-4a3f-9c3d-fbe98eea705f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:22:52.306027 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 06:22:52.306027 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: warnings.warn(msg) May 19 06:22:52.328138 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG dbcounter [-] [102983] Writing DB stats nova_api:SELECT=3 {{(pid=102983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:22:52.329326 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG dbcounter [-] [102983] Writing DB stats nova_cell1:SELECT=3 {{(pid=102983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:22:52.331357 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG dbcounter [-] [102983] Writing DB stats nova_cell0:SELECT=3 {{(pid=102983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:22:52.332335 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG dbcounter [-] [102983] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=102983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:22:52.383098 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-51fd67d1-5129-4a3f-9c3d-fbe98eea705f admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.306069 May 19 06:22:52.395485 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 4/6] 10.222.0.65 () {64 vars in 1335 bytes} [Thu May 19 06:22:52 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:22:54.910745 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-a91fffab-9e82-4d80-94b2-07032f5a8480 admin admin] Calling method '>' {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:22:54.913990 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-a91fffab-9e82-4d80-94b2-07032f5a8480 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002039 May 19 06:22:54.920105 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 3/7] 10.222.0.65 () {54 vars in 930 bytes} [Thu May 19 06:22:54 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:22:55.041803 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-00684e57-cbb6-4cb6-9094-a71d5795a979 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "swap": 0, "vcpus": 1, "name": "ds512M", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1"}} {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:22:55.061004 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 06:22:55.061004 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: warnings.warn(msg) May 19 06:22:55.082823 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-00684e57-cbb6-4cb6-9094-a71d5795a979 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.161539 May 19 06:22:55.083421 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 5/8] 10.222.0.65 () {64 vars in 1282 bytes} [Thu May 19 06:22:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 06:22:55.095133 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-082de034-b5dc-4967-b929-628a4f64e048 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:22:55.097501 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 06:22:55.097501 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: warnings.warn(msg) May 19 06:22:55.134795 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-082de034-b5dc-4967-b929-628a4f64e048 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043328 May 19 06:22:55.135356 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 4/9] 10.222.0.65 () {64 vars in 1335 bytes} [Thu May 19 06:22:55 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:22:57.603643 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-00684e57-cbb6-4cb6-9094-a71d5795a979 admin admin] Calling method '>' {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:22:57.604674 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-00684e57-cbb6-4cb6-9094-a71d5795a979 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 May 19 06:22:57.605258 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 6/10] 10.222.0.65 () {54 vars in 930 bytes} [Thu May 19 06:22:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:22:57.694705 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-511afb30-64c1-49d8-b494-2bfda96df59c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds1G", "vcpus": 1, "id": "d2", "os-flavor-access:is_public": true, "disk": 10, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:22:57.718989 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-511afb30-64c1-49d8-b494-2bfda96df59c admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.107306 May 19 06:22:57.721351 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 5/11] 10.222.0.65 () {64 vars in 1282 bytes} [Thu May 19 06:22:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 06:22:57.737835 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-f25ed702-f432-4d8f-851f-aa81a40e02c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:22:57.766931 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-f25ed702-f432-4d8f-851f-aa81a40e02c7 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034226 May 19 06:22:57.779529 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 7/12] 10.222.0.65 () {64 vars in 1335 bytes} [Thu May 19 06:22:57 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:23:00.364513 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-511afb30-64c1-49d8-b494-2bfda96df59c admin admin] Calling method '>' {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:00.365597 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-511afb30-64c1-49d8-b494-2bfda96df59c admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 May 19 06:23:00.366022 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 6/13] 10.222.0.65 () {54 vars in 930 bytes} [Thu May 19 06:23:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:23:00.438312 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-f45a6d0e-9b45-429d-a4d1-77d06783dbc4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 2048, "disk": 10, "id": "d3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "ds2G"}} {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:23:00.459157 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-f45a6d0e-9b45-429d-a4d1-77d06783dbc4 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.086057 May 19 06:23:00.459957 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 8/14] 10.222.0.65 () {64 vars in 1282 bytes} [Thu May 19 06:23:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 06:23:00.472225 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-bd55a98b-0758-48c5-9afc-ee8e0fa5c95f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:23:00.497478 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-bd55a98b-0758-48c5-9afc-ee8e0fa5c95f admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028969 May 19 06:23:00.498403 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 7/15] 10.222.0.65 () {64 vars in 1335 bytes} [Thu May 19 06:23:00 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:23:02.856791 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-f45a6d0e-9b45-429d-a4d1-77d06783dbc4 admin admin] Calling method '>' {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:02.857852 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-f45a6d0e-9b45-429d-a4d1-77d06783dbc4 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 May 19 06:23:02.858470 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 9/16] 10.222.0.65 () {54 vars in 930 bytes} [Thu May 19 06:23:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:23:02.927525 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-b025826a-a064-49b4-81ee-13b55be800ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "name": "ds4G", "vcpus": 4, "disk": 20, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0}} {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:23:02.956805 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-b025826a-a064-49b4-81ee-13b55be800ac admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.091576 May 19 06:23:02.957843 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 8/17] 10.222.0.65 () {64 vars in 1282 bytes} [Thu May 19 06:23:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 06:23:02.975186 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-2f756542-168a-4571-8379-07006e91514f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:23:03.008129 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-2f756542-168a-4571-8379-07006e91514f admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036457 May 19 06:23:03.009543 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 10/18] 10.222.0.65 () {64 vars in 1335 bytes} [Thu May 19 06:23:02 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:23:05.415583 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-b025826a-a064-49b4-81ee-13b55be800ac admin admin] Calling method '>' {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:05.416604 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-b025826a-a064-49b4-81ee-13b55be800ac admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 19 06:23:05.417008 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 9/19] 10.222.0.65 () {54 vars in 930 bytes} [Thu May 19 06:23:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:23:05.489217 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-64cf666a-32d6-4ede-aef8-99f247674319 admin admin] Calling method '>' {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:05.526122 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-64cf666a-32d6-4ede-aef8-99f247674319 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.101326 May 19 06:23:05.527063 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 11/20] 10.222.0.65 () {60 vars in 1291 bytes} [Thu May 19 06:23:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:23:07.893596 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-b025826a-a064-49b4-81ee-13b55be800ac admin admin] Calling method '>' {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:07.894621 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-b025826a-a064-49b4-81ee-13b55be800ac admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001627 May 19 06:23:07.895037 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 10/21] 10.222.0.65 () {54 vars in 930 bytes} [Thu May 19 06:23:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:23:07.972653 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-67281392-d0d7-4783-b1dc-ada77050df27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "swap": 0, "ram": 512, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny"}} {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:23:07.991994 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-67281392-d0d7-4783-b1dc-ada77050df27 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.090651 May 19 06:23:07.992699 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 12/22] 10.222.0.65 () {64 vars in 1282 bytes} [Thu May 19 06:23:07 2022] POST /compute/v2.1/flavors => generated 402 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 06:23:08.007983 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-954b9971-ef6c-4f9c-9f01-85e4a587ca2a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:23:08.044075 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-954b9971-ef6c-4f9c-9f01-85e4a587ca2a admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042855 May 19 06:23:08.045064 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 11/23] 10.222.0.65 () {64 vars in 1332 bytes} [Thu May 19 06:23:07 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:23:10.437537 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-67281392-d0d7-4783-b1dc-ada77050df27 admin admin] Calling method '>' {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:10.438572 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-67281392-d0d7-4783-b1dc-ada77050df27 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 May 19 06:23:10.439216 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 13/24] 10.222.0.65 () {54 vars in 930 bytes} [Thu May 19 06:23:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:23:10.504846 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-c5cce39b-cad1-4608-a9f4-1fbe42ca709e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "name": "m1.small", "id": "2", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1}} {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:23:10.530912 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-c5cce39b-cad1-4608-a9f4-1fbe42ca709e admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.085007 May 19 06:23:10.531476 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 12/25] 10.222.0.65 () {64 vars in 1282 bytes} [Thu May 19 06:23:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 06:23:10.544166 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-b579d41b-c54d-41eb-a3d8-0e120c7ecc4a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:23:10.570104 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-b579d41b-c54d-41eb-a3d8-0e120c7ecc4a admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029671 May 19 06:23:10.570711 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 14/26] 10.222.0.65 () {64 vars in 1332 bytes} [Thu May 19 06:23:10 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:23:13.373019 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-c5cce39b-cad1-4608-a9f4-1fbe42ca709e admin admin] Calling method '>' {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:13.374077 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-c5cce39b-cad1-4608-a9f4-1fbe42ca709e admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001651 May 19 06:23:13.374490 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 13/27] 10.222.0.65 () {54 vars in 930 bytes} [Thu May 19 06:23:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:23:13.436964 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-6640e3f7-e646-4ae6-a937-d2a9b437f95e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.medium", "disk": 40, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:23:13.454397 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-6640e3f7-e646-4ae6-a937-d2a9b437f95e admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073881 May 19 06:23:13.454959 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 15/28] 10.222.0.65 () {64 vars in 1282 bytes} [Thu May 19 06:23:13 2022] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 06:23:13.466786 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-b5885793-89f9-4325-b8d9-942355ff609c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:23:13.492096 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-b5885793-89f9-4325-b8d9-942355ff609c admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029013 May 19 06:23:13.492714 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 14/29] 10.222.0.65 () {64 vars in 1332 bytes} [Thu May 19 06:23:13 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:23:15.812792 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-6640e3f7-e646-4ae6-a937-d2a9b437f95e admin admin] Calling method '>' {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:15.814068 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-6640e3f7-e646-4ae6-a937-d2a9b437f95e admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 May 19 06:23:15.814602 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 16/30] 10.222.0.65 () {54 vars in 930 bytes} [Thu May 19 06:23:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:23:15.880348 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-af6e4b7e-b8ed-42fa-925a-855dad8fc513 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "disk": 80, "name": "m1.large", "os-flavor-access:is_public": true, "vcpus": 4, "ram": 8192, "swap": 0}} {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:23:15.899926 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-af6e4b7e-b8ed-42fa-925a-855dad8fc513 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079006 May 19 06:23:15.900485 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 15/31] 10.222.0.65 () {64 vars in 1282 bytes} [Thu May 19 06:23:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 06:23:15.916690 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-437333a6-b016-4e40-9a0c-2025200c0abb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:23:15.952759 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-437333a6-b016-4e40-9a0c-2025200c0abb admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042573 May 19 06:23:15.953381 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 17/32] 10.222.0.65 () {64 vars in 1332 bytes} [Thu May 19 06:23:15 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:23:18.276378 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-af6e4b7e-b8ed-42fa-925a-855dad8fc513 admin admin] Calling method '>' {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:18.278094 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-af6e4b7e-b8ed-42fa-925a-855dad8fc513 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002114 May 19 06:23:18.278502 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 16/33] 10.222.0.65 () {54 vars in 930 bytes} [Thu May 19 06:23:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:23:18.340216 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-2e24cdbe-ffca-424d-8fda-7aab9086fdb1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "vcpus": 8, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 16384, "os-flavor-access:is_public": true, "swap": 0, "disk": 160}} {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:23:18.360481 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-2e24cdbe-ffca-424d-8fda-7aab9086fdb1 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.075057 May 19 06:23:18.361379 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 18/34] 10.222.0.65 () {64 vars in 1282 bytes} [Thu May 19 06:23:18 2022] POST /compute/v2.1/flavors => generated 408 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 06:23:18.372839 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-0e5f5218-6bc0-405a-bb31-a32ec776c495 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:23:18.397043 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-0e5f5218-6bc0-405a-bb31-a32ec776c495 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027777 May 19 06:23:18.401639 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 17/35] 10.222.0.65 () {64 vars in 1332 bytes} [Thu May 19 06:23:18 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:23:44.516356 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-2e24cdbe-ffca-424d-8fda-7aab9086fdb1 admin admin] Calling method '>' {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:44.517794 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-2e24cdbe-ffca-424d-8fda-7aab9086fdb1 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002033 May 19 06:23:44.520375 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 19/36] 10.222.0.65 () {54 vars in 930 bytes} [Thu May 19 06:23:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:23:44.526715 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG dbcounter [-] [102982] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=102982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:23:44.582058 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-68647412-2b2f-4029-9e98-bf197432e955 admin admin] Calling method '>' {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:44.599864 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-68647412-2b2f-4029-9e98-bf197432e955 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.074020 May 19 06:23:44.600320 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 18/37] 10.222.0.65 () {60 vars in 1291 bytes} [Thu May 19 06:23:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:23:45.732169 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-2e24cdbe-ffca-424d-8fda-7aab9086fdb1 admin admin] Calling method '>' {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:45.733170 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-2e24cdbe-ffca-424d-8fda-7aab9086fdb1 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 May 19 06:23:45.733624 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 20/38] 10.222.0.65 () {56 vars in 1074 bytes} [Thu May 19 06:23:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:23:45.937272 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-8325476e-3c40-4004-82e8-718da01302ca admin admin] Calling method '>' {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:45.943320 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.wsgi [None req-8325476e-3c40-4004-82e8-718da01302ca admin admin] HTTP exception thrown: Flavor 42 could not be found. May 19 06:23:45.947116 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-8325476e-3c40-4004-82e8-718da01302ca admin admin] Request method failure captured: May 19 06:23:45.947116 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 19 06:23:45.947116 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: Accept: application/json May 19 06:23:45.947116 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: Accept-Encoding: gzip, deflate May 19 06:23:45.947116 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: Connection: keep-alive May 19 06:23:45.947116 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: Content-Length: 0 May 19 06:23:45.947116 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: Host: 10.222.0.65 May 19 06:23:45.947116 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: Openstack-Api-Version: compute 2.90 May 19 06:23:45.947116 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: Openstack-System-Scope: None May 19 06:23:45.947116 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: User-Agent: python-novaclient May 19 06:23:45.947116 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Auth-Token: gAAAAABiheJxGzka0cmDKvwx7SE7zV3EWExVRkcsJpCoc7JhqogtirhX7Q4FWOLvd73lPk597kFCXGWuq4Il6hvxFnzc2utw3FnExfLRZysm-bU0_skSG5msZ5Kmyufy8PwxU3JUOQ1YcVP78OeqLnP6TBJb1qUXJ7vC4ghCxxZ2XBl4NQLfNoA May 19 06:23:45.947116 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Domain-Id: None May 19 06:23:45.947116 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Domain-Name: None May 19 06:23:45.947116 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Identity-Status: Confirmed May 19 06:23:45.947116 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Is-Admin-Project: True May 19 06:23:45.947116 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Openstack-Nova-Api-Version: 2.90 May 19 06:23:45.947116 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Project-Domain-Id: default May 19 06:23:45.947116 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Project-Domain-Name: Default May 19 06:23:45.947116 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Project-Id: 0443648214584699a9ada0deda814964 May 19 06:23:45.947116 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Project-Name: admin May 19 06:23:45.947116 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Role: admin,reader,member May 19 06:23:45.947116 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Roles: admin,reader,member May 19 06:23:45.948861 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0443648214584699a9ada0deda814964"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0443648214584699a9ada0deda814964"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0443648214584699a9ada0deda814964"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0443648214584699a9ada0deda814964", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:23:45.948861 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Tenant: admin May 19 06:23:45.948861 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Tenant-Id: 0443648214584699a9ada0deda814964 May 19 06:23:45.948861 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Tenant-Name: admin May 19 06:23:45.948861 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-User: admin May 19 06:23:45.948861 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-User-Domain-Id: default May 19 06:23:45.948861 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-User-Domain-Name: Default May 19 06:23:45.948861 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-User-Id: 5a11fde32c844e228722284109f82f80 May 19 06:23:45.948861 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-User-Name: admin May 19 06:23:45.948861 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: method: > May 19 06:23:45.948861 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: exception: Flavor 42 could not be found. May 19 06:23:45.948861 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: action_args: {'id': '42'} May 19 06:23:45.948861 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:23:45.948861 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:23:45.949828 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 06:23:45.949828 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 06:23:45.949828 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 06:23:45.949828 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 06:23:45.949828 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 06:23:45.949828 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 06:23:45.949828 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 06:23:45.949828 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 06:23:45.949828 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 06:23:45.949828 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:23:45.949828 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 06:23:45.949828 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 06:23:45.949828 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 19 06:23:45.949828 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi May 19 06:23:45.949828 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:23:45.949828 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi May 19 06:23:45.949828 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:23:45.949828 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:23:45.949828 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:23:45.951057 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:23:45.951057 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:23:45.951057 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:23:45.951057 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:23:45.951057 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 06:23:45.951057 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 06:23:45.951057 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 19 06:23:45.951057 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi May 19 06:23:45.951057 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:23:45.951057 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi May 19 06:23:45.951057 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:23:45.951057 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:23:45.951057 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:23:45.951057 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:23:45.951057 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:23:45.951057 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 19 06:23:45.951057 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi May 19 06:23:45.951057 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-8325476e-3c40-4004-82e8-718da01302ca admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:23:45.952143 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-8325476e-3c40-4004-82e8-718da01302ca admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.065838 May 19 06:23:45.952143 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 19/39] 10.222.0.65 () {60 vars in 1190 bytes} [Thu May 19 06:23:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 06:23:45.958921 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-a3473b0f-63c0-4600-a41a-fbc76bb9b6d5 admin admin] Calling method '>' {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:45.961764 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG dbcounter [-] [102983] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=102983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:23:45.982035 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-a3473b0f-63c0-4600-a41a-fbc76bb9b6d5 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026658 May 19 06:23:45.983200 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 21/40] 10.222.0.65 () {60 vars in 1210 bytes} [Thu May 19 06:23:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:23:45.992666 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-13bd3dd4-e399-412f-841d-9c8ac19f67cf admin admin] Calling method '>' {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:46.014187 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-13bd3dd4-e399-412f-841d-9c8ac19f67cf admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025160 May 19 06:23:46.014789 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 20/41] 10.222.0.65 () {60 vars in 1210 bytes} [Thu May 19 06:23:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:23:46.025453 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-3a3e25d7-ddd4-4219-a5d2-61a2ee5d8d36 admin admin] Calling method '>' {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:46.031491 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.wsgi [None req-3a3e25d7-ddd4-4219-a5d2-61a2ee5d8d36 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 19 06:23:46.035442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-3a3e25d7-ddd4-4219-a5d2-61a2ee5d8d36 admin admin] Request method failure captured: May 19 06:23:46.035442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 19 06:23:46.035442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: Accept: application/json May 19 06:23:46.035442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: Accept-Encoding: gzip, deflate May 19 06:23:46.035442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: Connection: keep-alive May 19 06:23:46.035442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: Content-Length: 0 May 19 06:23:46.035442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: Host: 10.222.0.65 May 19 06:23:46.035442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: Openstack-Api-Version: compute 2.90 May 19 06:23:46.035442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: Openstack-System-Scope: None May 19 06:23:46.035442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: User-Agent: python-novaclient May 19 06:23:46.035442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Auth-Token: gAAAAABiheJxGzka0cmDKvwx7SE7zV3EWExVRkcsJpCoc7JhqogtirhX7Q4FWOLvd73lPk597kFCXGWuq4Il6hvxFnzc2utw3FnExfLRZysm-bU0_skSG5msZ5Kmyufy8PwxU3JUOQ1YcVP78OeqLnP6TBJb1qUXJ7vC4ghCxxZ2XBl4NQLfNoA May 19 06:23:46.035442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Domain-Id: None May 19 06:23:46.035442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Domain-Name: None May 19 06:23:46.035442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Identity-Status: Confirmed May 19 06:23:46.035442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Is-Admin-Project: True May 19 06:23:46.035442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Openstack-Nova-Api-Version: 2.90 May 19 06:23:46.035442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Project-Domain-Id: default May 19 06:23:46.035442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Project-Domain-Name: Default May 19 06:23:46.035442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Project-Id: 0443648214584699a9ada0deda814964 May 19 06:23:46.035442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Project-Name: admin May 19 06:23:46.035442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Role: admin,reader,member May 19 06:23:46.035442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Roles: admin,reader,member May 19 06:23:46.037005 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0443648214584699a9ada0deda814964"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0443648214584699a9ada0deda814964"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0443648214584699a9ada0deda814964"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0443648214584699a9ada0deda814964", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:23:46.037005 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Tenant: admin May 19 06:23:46.037005 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Tenant-Id: 0443648214584699a9ada0deda814964 May 19 06:23:46.037005 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Tenant-Name: admin May 19 06:23:46.037005 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-User: admin May 19 06:23:46.037005 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-User-Domain-Id: default May 19 06:23:46.037005 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-User-Domain-Name: Default May 19 06:23:46.037005 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-User-Id: 5a11fde32c844e228722284109f82f80 May 19 06:23:46.037005 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-User-Name: admin May 19 06:23:46.037005 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: method: > May 19 06:23:46.037005 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: exception: Flavor 42 could not be found. May 19 06:23:46.037005 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: action_args: {'id': '42'} May 19 06:23:46.037005 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:23:46.037005 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:23:46.038019 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 06:23:46.038019 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 06:23:46.038019 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 06:23:46.038019 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 06:23:46.038019 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 06:23:46.038019 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 06:23:46.038019 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 06:23:46.038019 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 06:23:46.038019 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 06:23:46.038019 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:23:46.038019 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 06:23:46.038019 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 06:23:46.038019 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 19 06:23:46.038019 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi May 19 06:23:46.038019 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:23:46.038019 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi May 19 06:23:46.038019 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:23:46.038019 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:23:46.038019 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:23:46.039399 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:23:46.039399 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:23:46.039399 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:23:46.039399 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:23:46.039399 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 06:23:46.039399 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 06:23:46.039399 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 19 06:23:46.039399 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi May 19 06:23:46.039399 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:23:46.039399 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi May 19 06:23:46.039399 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:23:46.039399 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:23:46.039399 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:23:46.039399 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:23:46.039399 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:23:46.039399 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 19 06:23:46.039399 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi May 19 06:23:46.039399 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-3a3e25d7-ddd4-4219-a5d2-61a2ee5d8d36 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:23:46.040638 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-3a3e25d7-ddd4-4219-a5d2-61a2ee5d8d36 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015414 May 19 06:23:46.040890 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 22/42] 10.222.0.65 () {60 vars in 1190 bytes} [Thu May 19 06:23:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 06:23:46.933554 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-13bd3dd4-e399-412f-841d-9c8ac19f67cf admin admin] Calling method '>' {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:46.934569 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-13bd3dd4-e399-412f-841d-9c8ac19f67cf admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 May 19 06:23:46.934970 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 21/43] 10.222.0.65 () {56 vars in 1074 bytes} [Thu May 19 06:23:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:23:47.124090 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-b7c6b70e-1553-4d4f-8444-232f0773bce2 admin admin] Calling method '>' {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:47.131760 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.wsgi [None req-b7c6b70e-1553-4d4f-8444-232f0773bce2 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 19 06:23:47.133293 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-b7c6b70e-1553-4d4f-8444-232f0773bce2 admin admin] Request method failure captured: May 19 06:23:47.133293 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 19 06:23:47.133293 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: Accept: application/json May 19 06:23:47.133293 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: Accept-Encoding: gzip, deflate May 19 06:23:47.133293 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: Connection: keep-alive May 19 06:23:47.133293 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: Content-Length: 0 May 19 06:23:47.133293 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: Host: 10.222.0.65 May 19 06:23:47.133293 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: Openstack-Api-Version: compute 2.90 May 19 06:23:47.133293 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: Openstack-System-Scope: None May 19 06:23:47.133293 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: User-Agent: python-novaclient May 19 06:23:47.133293 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Auth-Token: gAAAAABiheJy_n7ybkFxTIZPeUEK29r9_QKl08j6TUy3GQXTa3QiGacMQYFbzpW3MD9LU8tYswtY2VGv7IeTDOGx-TVa1l59b0A74sTjgB-6wedbdtB4BZdMP6W2jG3UH8_2UX4w9DgP_FrIVYcxz0MRWJn0Hk-gr8dqR-G5T7r2HiCmKtUnpi0 May 19 06:23:47.133293 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Domain-Id: None May 19 06:23:47.133293 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Domain-Name: None May 19 06:23:47.133293 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Identity-Status: Confirmed May 19 06:23:47.133293 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Is-Admin-Project: True May 19 06:23:47.133293 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Openstack-Nova-Api-Version: 2.90 May 19 06:23:47.133293 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Project-Domain-Id: default May 19 06:23:47.133293 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Project-Domain-Name: Default May 19 06:23:47.133293 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Project-Id: 0443648214584699a9ada0deda814964 May 19 06:23:47.133293 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Project-Name: admin May 19 06:23:47.133293 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Role: admin,reader,member May 19 06:23:47.133293 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Roles: admin,reader,member May 19 06:23:47.134619 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0443648214584699a9ada0deda814964"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0443648214584699a9ada0deda814964"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0443648214584699a9ada0deda814964"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0443648214584699a9ada0deda814964", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:23:47.134619 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Tenant: admin May 19 06:23:47.134619 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Tenant-Id: 0443648214584699a9ada0deda814964 May 19 06:23:47.134619 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Tenant-Name: admin May 19 06:23:47.134619 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-User: admin May 19 06:23:47.134619 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-User-Domain-Id: default May 19 06:23:47.134619 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-User-Domain-Name: Default May 19 06:23:47.134619 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-User-Id: 5a11fde32c844e228722284109f82f80 May 19 06:23:47.134619 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-User-Name: admin May 19 06:23:47.134619 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: method: > May 19 06:23:47.134619 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: exception: Flavor 84 could not be found. May 19 06:23:47.134619 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: action_args: {'id': '84'} May 19 06:23:47.134619 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:23:47.134619 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:23:47.135442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 06:23:47.135442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 06:23:47.135442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 06:23:47.135442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 06:23:47.135442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 06:23:47.135442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 06:23:47.135442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 06:23:47.135442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 06:23:47.135442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 06:23:47.135442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:23:47.135442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 06:23:47.135442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 06:23:47.135442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 19 06:23:47.135442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi May 19 06:23:47.135442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:23:47.135442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi May 19 06:23:47.135442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:23:47.135442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:23:47.135442 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:23:47.136494 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:23:47.136494 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:23:47.136494 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:23:47.136494 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:23:47.136494 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 06:23:47.136494 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 06:23:47.136494 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 19 06:23:47.136494 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi May 19 06:23:47.136494 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:23:47.136494 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi May 19 06:23:47.136494 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:23:47.136494 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:23:47.136494 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:23:47.136494 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:23:47.136494 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:23:47.136494 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 19 06:23:47.136494 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi May 19 06:23:47.136494 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-b7c6b70e-1553-4d4f-8444-232f0773bce2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:23:47.137605 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-b7c6b70e-1553-4d4f-8444-232f0773bce2 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.064044 May 19 06:23:47.137605 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 23/44] 10.222.0.65 () {60 vars in 1190 bytes} [Thu May 19 06:23:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 06:23:47.145342 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-aaaccd77-4e27-414a-bbbe-b1129ab54d36 admin admin] Calling method '>' {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:47.159367 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-aaaccd77-4e27-414a-bbbe-b1129ab54d36 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018481 May 19 06:23:47.159920 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 22/45] 10.222.0.65 () {60 vars in 1210 bytes} [Thu May 19 06:23:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:23:47.169546 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-6cf82de5-0d4a-409e-8f24-ae0a6cbe9aa8 admin admin] Calling method '>' {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:47.183533 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-6cf82de5-0d4a-409e-8f24-ae0a6cbe9aa8 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017487 May 19 06:23:47.184079 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 24/46] 10.222.0.65 () {60 vars in 1210 bytes} [Thu May 19 06:23:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:23:47.194260 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-d181fbd1-c7df-4b9b-8e29-551500c1babd admin admin] Calling method '>' {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:47.199682 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.wsgi [None req-d181fbd1-c7df-4b9b-8e29-551500c1babd admin admin] HTTP exception thrown: Flavor 84 could not be found. May 19 06:23:47.201189 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-d181fbd1-c7df-4b9b-8e29-551500c1babd admin admin] Request method failure captured: May 19 06:23:47.201189 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 19 06:23:47.201189 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: Accept: application/json May 19 06:23:47.201189 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: Accept-Encoding: gzip, deflate May 19 06:23:47.201189 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: Connection: keep-alive May 19 06:23:47.201189 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: Content-Length: 0 May 19 06:23:47.201189 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: Host: 10.222.0.65 May 19 06:23:47.201189 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: Openstack-Api-Version: compute 2.90 May 19 06:23:47.201189 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: Openstack-System-Scope: None May 19 06:23:47.201189 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: User-Agent: python-novaclient May 19 06:23:47.201189 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Auth-Token: gAAAAABiheJy_n7ybkFxTIZPeUEK29r9_QKl08j6TUy3GQXTa3QiGacMQYFbzpW3MD9LU8tYswtY2VGv7IeTDOGx-TVa1l59b0A74sTjgB-6wedbdtB4BZdMP6W2jG3UH8_2UX4w9DgP_FrIVYcxz0MRWJn0Hk-gr8dqR-G5T7r2HiCmKtUnpi0 May 19 06:23:47.201189 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Domain-Id: None May 19 06:23:47.201189 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Domain-Name: None May 19 06:23:47.201189 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Identity-Status: Confirmed May 19 06:23:47.201189 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Is-Admin-Project: True May 19 06:23:47.201189 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Openstack-Nova-Api-Version: 2.90 May 19 06:23:47.201189 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Project-Domain-Id: default May 19 06:23:47.201189 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Project-Domain-Name: Default May 19 06:23:47.201189 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Project-Id: 0443648214584699a9ada0deda814964 May 19 06:23:47.201189 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Project-Name: admin May 19 06:23:47.201189 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Role: admin,reader,member May 19 06:23:47.201189 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Roles: admin,reader,member May 19 06:23:47.202739 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0443648214584699a9ada0deda814964"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0443648214584699a9ada0deda814964"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0443648214584699a9ada0deda814964"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0443648214584699a9ada0deda814964", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:23:47.202739 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Tenant: admin May 19 06:23:47.202739 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Tenant-Id: 0443648214584699a9ada0deda814964 May 19 06:23:47.202739 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Tenant-Name: admin May 19 06:23:47.202739 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-User: admin May 19 06:23:47.202739 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-User-Domain-Id: default May 19 06:23:47.202739 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-User-Domain-Name: Default May 19 06:23:47.202739 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-User-Id: 5a11fde32c844e228722284109f82f80 May 19 06:23:47.202739 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-User-Name: admin May 19 06:23:47.202739 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: method: > May 19 06:23:47.202739 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: exception: Flavor 84 could not be found. May 19 06:23:47.202739 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: action_args: {'id': '84'} May 19 06:23:47.202739 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:23:47.202739 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:23:47.203734 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 06:23:47.203734 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 06:23:47.203734 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 06:23:47.203734 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 06:23:47.203734 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 06:23:47.203734 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 06:23:47.203734 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 06:23:47.203734 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 06:23:47.203734 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 06:23:47.203734 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:23:47.203734 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 06:23:47.203734 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 06:23:47.203734 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 19 06:23:47.203734 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi May 19 06:23:47.203734 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:23:47.203734 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi May 19 06:23:47.203734 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:23:47.203734 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:23:47.203734 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:23:47.205223 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:23:47.205223 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:23:47.205223 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:23:47.205223 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:23:47.205223 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 06:23:47.205223 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 06:23:47.205223 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 19 06:23:47.205223 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi May 19 06:23:47.205223 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:23:47.205223 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi May 19 06:23:47.205223 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:23:47.205223 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:23:47.205223 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:23:47.205223 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:23:47.205223 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:23:47.205223 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 19 06:23:47.205223 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi May 19 06:23:47.205223 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-d181fbd1-c7df-4b9b-8e29-551500c1babd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:23:47.206510 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-d181fbd1-c7df-4b9b-8e29-551500c1babd admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011973 May 19 06:23:47.206510 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 23/47] 10.222.0.65 () {60 vars in 1190 bytes} [Thu May 19 06:23:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 06:23:48.108980 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-6cf82de5-0d4a-409e-8f24-ae0a6cbe9aa8 admin admin] Calling method '>' {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:48.110388 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-6cf82de5-0d4a-409e-8f24-ae0a6cbe9aa8 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 May 19 06:23:48.110800 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 25/48] 10.222.0.65 () {56 vars in 1074 bytes} [Thu May 19 06:23:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:23:48.307708 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-1a6e4ec8-d303-43d8-a10b-cec1660a391f admin admin] Calling method '>' {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:48.314047 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.wsgi [None req-1a6e4ec8-d303-43d8-a10b-cec1660a391f admin admin] HTTP exception thrown: Flavor 451 could not be found. May 19 06:23:48.315554 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-1a6e4ec8-d303-43d8-a10b-cec1660a391f admin admin] Request method failure captured: May 19 06:23:48.315554 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 19 06:23:48.315554 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: Accept: application/json May 19 06:23:48.315554 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: Accept-Encoding: gzip, deflate May 19 06:23:48.315554 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: Connection: keep-alive May 19 06:23:48.315554 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: Content-Length: 0 May 19 06:23:48.315554 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: Host: 10.222.0.65 May 19 06:23:48.315554 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: Openstack-Api-Version: compute 2.90 May 19 06:23:48.315554 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: Openstack-System-Scope: None May 19 06:23:48.315554 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: User-Agent: python-novaclient May 19 06:23:48.315554 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Auth-Token: gAAAAABiheJ0kE5h43S5QvzkXx45_n82eKY1q5I72S5gOZ9VfANQmnvrvEPOe8qjfAhzGrPFHZfcwnXNclQdKm4mDsuXTA3EgtQ5k7n2JOtjqmzssNLjDFgvt1pY0cl-ecSqv8nnft9f1N0uCGQ2hFl4nnyEOfeSU3NBfPUYG-rsWHD_j5S0ABw May 19 06:23:48.315554 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Domain-Id: None May 19 06:23:48.315554 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Domain-Name: None May 19 06:23:48.315554 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Identity-Status: Confirmed May 19 06:23:48.315554 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Is-Admin-Project: True May 19 06:23:48.315554 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Openstack-Nova-Api-Version: 2.90 May 19 06:23:48.315554 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Project-Domain-Id: default May 19 06:23:48.315554 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Project-Domain-Name: Default May 19 06:23:48.315554 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Project-Id: 0443648214584699a9ada0deda814964 May 19 06:23:48.315554 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Project-Name: admin May 19 06:23:48.315554 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Role: admin,reader,member May 19 06:23:48.315554 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Roles: admin,reader,member May 19 06:23:48.317232 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0443648214584699a9ada0deda814964"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0443648214584699a9ada0deda814964"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0443648214584699a9ada0deda814964"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0443648214584699a9ada0deda814964", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:23:48.317232 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Tenant: admin May 19 06:23:48.317232 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Tenant-Id: 0443648214584699a9ada0deda814964 May 19 06:23:48.317232 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-Tenant-Name: admin May 19 06:23:48.317232 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-User: admin May 19 06:23:48.317232 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-User-Domain-Id: default May 19 06:23:48.317232 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-User-Domain-Name: Default May 19 06:23:48.317232 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-User-Id: 5a11fde32c844e228722284109f82f80 May 19 06:23:48.317232 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: X-User-Name: admin May 19 06:23:48.317232 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: method: > May 19 06:23:48.317232 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: exception: Flavor 451 could not be found. May 19 06:23:48.317232 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: action_args: {'id': '451'} May 19 06:23:48.317232 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:23:48.317232 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:23:48.318233 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 06:23:48.318233 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 06:23:48.318233 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 06:23:48.318233 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 06:23:48.318233 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 06:23:48.318233 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 06:23:48.318233 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 06:23:48.318233 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 06:23:48.318233 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 06:23:48.318233 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:23:48.318233 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 06:23:48.318233 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 06:23:48.318233 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 19 06:23:48.318233 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi May 19 06:23:48.318233 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:23:48.318233 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi May 19 06:23:48.318233 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:23:48.318233 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:23:48.318233 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:23:48.319343 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:23:48.319343 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:23:48.319343 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:23:48.319343 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:23:48.319343 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 06:23:48.319343 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 06:23:48.319343 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 19 06:23:48.319343 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi May 19 06:23:48.319343 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:23:48.319343 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi May 19 06:23:48.319343 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:23:48.319343 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:23:48.319343 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:23:48.319343 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:23:48.319343 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:23:48.319343 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 19 06:23:48.319343 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: ERROR nova.api.openstack.wsgi May 19 06:23:48.319343 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-1a6e4ec8-d303-43d8-a10b-cec1660a391f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:23:48.321065 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-1a6e4ec8-d303-43d8-a10b-cec1660a391f admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061769 May 19 06:23:48.321065 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 24/49] 10.222.0.65 () {60 vars in 1193 bytes} [Thu May 19 06:23:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 06:23:48.327048 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-e229030f-0a32-40bd-bd0f-a2a17c0a9f56 admin admin] Calling method '>' {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:48.341086 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-e229030f-0a32-40bd-bd0f-a2a17c0a9f56 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017693 May 19 06:23:48.341733 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 26/50] 10.222.0.65 () {60 vars in 1210 bytes} [Thu May 19 06:23:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:23:48.351899 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-83308d0b-24a3-4512-8859-80f29700a5b8 admin admin] Calling method '>' {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:48.369148 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-83308d0b-24a3-4512-8859-80f29700a5b8 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020739 May 19 06:23:48.369746 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 25/51] 10.222.0.65 () {60 vars in 1210 bytes} [Thu May 19 06:23:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:23:48.379258 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-911cd828-56c5-4875-9cfe-4e4ee56e8fbb admin admin] Calling method '>' {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:48.385454 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.wsgi [None req-911cd828-56c5-4875-9cfe-4e4ee56e8fbb admin admin] HTTP exception thrown: Flavor 451 could not be found. May 19 06:23:48.386960 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-911cd828-56c5-4875-9cfe-4e4ee56e8fbb admin admin] Request method failure captured: May 19 06:23:48.386960 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 19 06:23:48.386960 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: Accept: application/json May 19 06:23:48.386960 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: Accept-Encoding: gzip, deflate May 19 06:23:48.386960 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: Connection: keep-alive May 19 06:23:48.386960 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: Content-Length: 0 May 19 06:23:48.386960 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: Host: 10.222.0.65 May 19 06:23:48.386960 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: Openstack-Api-Version: compute 2.90 May 19 06:23:48.386960 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: Openstack-System-Scope: None May 19 06:23:48.386960 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: User-Agent: python-novaclient May 19 06:23:48.386960 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Auth-Token: gAAAAABiheJ0kE5h43S5QvzkXx45_n82eKY1q5I72S5gOZ9VfANQmnvrvEPOe8qjfAhzGrPFHZfcwnXNclQdKm4mDsuXTA3EgtQ5k7n2JOtjqmzssNLjDFgvt1pY0cl-ecSqv8nnft9f1N0uCGQ2hFl4nnyEOfeSU3NBfPUYG-rsWHD_j5S0ABw May 19 06:23:48.386960 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Domain-Id: None May 19 06:23:48.386960 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Domain-Name: None May 19 06:23:48.386960 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Identity-Status: Confirmed May 19 06:23:48.386960 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Is-Admin-Project: True May 19 06:23:48.386960 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Openstack-Nova-Api-Version: 2.90 May 19 06:23:48.386960 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Project-Domain-Id: default May 19 06:23:48.386960 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Project-Domain-Name: Default May 19 06:23:48.386960 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Project-Id: 0443648214584699a9ada0deda814964 May 19 06:23:48.386960 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Project-Name: admin May 19 06:23:48.386960 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Role: admin,reader,member May 19 06:23:48.386960 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Roles: admin,reader,member May 19 06:23:48.388463 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0443648214584699a9ada0deda814964"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0443648214584699a9ada0deda814964"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0443648214584699a9ada0deda814964"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0443648214584699a9ada0deda814964", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:23:48.388463 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Tenant: admin May 19 06:23:48.388463 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Tenant-Id: 0443648214584699a9ada0deda814964 May 19 06:23:48.388463 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-Tenant-Name: admin May 19 06:23:48.388463 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-User: admin May 19 06:23:48.388463 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-User-Domain-Id: default May 19 06:23:48.388463 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-User-Domain-Name: Default May 19 06:23:48.388463 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-User-Id: 5a11fde32c844e228722284109f82f80 May 19 06:23:48.388463 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: X-User-Name: admin May 19 06:23:48.388463 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: method: > May 19 06:23:48.388463 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: exception: Flavor 451 could not be found. May 19 06:23:48.388463 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: action_args: {'id': '451'} May 19 06:23:48.388463 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:23:48.388463 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:23:48.389582 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 06:23:48.389582 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 06:23:48.389582 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 06:23:48.389582 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 06:23:48.389582 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 06:23:48.389582 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 06:23:48.389582 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 06:23:48.389582 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 06:23:48.389582 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 06:23:48.389582 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:23:48.389582 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 06:23:48.389582 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 06:23:48.389582 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 19 06:23:48.389582 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi May 19 06:23:48.389582 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:23:48.389582 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi May 19 06:23:48.389582 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:23:48.389582 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:23:48.389582 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:23:48.391000 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:23:48.391000 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:23:48.391000 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:23:48.391000 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:23:48.391000 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 06:23:48.391000 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 06:23:48.391000 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 19 06:23:48.391000 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi May 19 06:23:48.391000 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:23:48.391000 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi May 19 06:23:48.391000 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:23:48.391000 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:23:48.391000 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:23:48.391000 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:23:48.391000 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:23:48.391000 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 19 06:23:48.391000 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: ERROR nova.api.openstack.wsgi May 19 06:23:48.391000 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-911cd828-56c5-4875-9cfe-4e4ee56e8fbb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:23:48.392249 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-911cd828-56c5-4875-9cfe-4e4ee56e8fbb admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012744 May 19 06:23:48.392249 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 27/52] 10.222.0.65 () {60 vars in 1193 bytes} [Thu May 19 06:23:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 06:23:49.320390 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-83308d0b-24a3-4512-8859-80f29700a5b8 admin admin] Calling method '>' {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:49.321532 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-83308d0b-24a3-4512-8859-80f29700a5b8 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 May 19 06:23:49.322219 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 26/53] 10.222.0.65 () {56 vars in 1074 bytes} [Thu May 19 06:23:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:23:49.513644 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-8a6c9be2-7f08-4c0b-9fa5-03bd4402cca9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:23:49.534370 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-8a6c9be2-7f08-4c0b-9fa5-03bd4402cca9 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.073723 May 19 06:23:49.534908 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 28/54] 10.222.0.65 () {64 vars in 1235 bytes} [Thu May 19 06:23:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 06:23:50.455776 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-83308d0b-24a3-4512-8859-80f29700a5b8 admin admin] Calling method '>' {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:50.456785 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-83308d0b-24a3-4512-8859-80f29700a5b8 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 19 06:23:50.457213 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 27/55] 10.222.0.65 () {56 vars in 1074 bytes} [Thu May 19 06:23:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:23:50.650488 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-e424ab8d-95ac-4570-b1a4-d4ad0113be97 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:23:50.669560 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-e424ab8d-95ac-4570-b1a4-d4ad0113be97 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.071808 May 19 06:23:50.670118 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 29/56] 10.222.0.65 () {64 vars in 1235 bytes} [Thu May 19 06:23:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 06:23:51.565753 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-83308d0b-24a3-4512-8859-80f29700a5b8 admin admin] Calling method '>' {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:51.566765 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-83308d0b-24a3-4512-8859-80f29700a5b8 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 May 19 06:23:51.567162 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 28/57] 10.222.0.65 () {56 vars in 1074 bytes} [Thu May 19 06:23:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:23:51.762652 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-17067767-6ffa-42e9-8cbf-1e7d0573005c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:23:51.780481 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-17067767-6ffa-42e9-8cbf-1e7d0573005c admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.072274 May 19 06:23:51.781045 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 30/58] 10.222.0.65 () {64 vars in 1235 bytes} [Thu May 19 06:23:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 06:23:52.693448 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-83308d0b-24a3-4512-8859-80f29700a5b8 admin admin] Calling method '>' {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:52.694460 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-83308d0b-24a3-4512-8859-80f29700a5b8 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 May 19 06:23:52.694859 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 29/59] 10.222.0.65 () {56 vars in 1074 bytes} [Thu May 19 06:23:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:23:52.885704 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-695f4c1b-e6ce-428d-a6b2-111e6cbb69da admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:23:52.903656 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-695f4c1b-e6ce-428d-a6b2-111e6cbb69da admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.071902 May 19 06:23:52.904135 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 31/60] 10.222.0.65 () {64 vars in 1235 bytes} [Thu May 19 06:23:52 2022] POST /compute/v2.1/flavors => generated 409 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 06:23:53.798265 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-83308d0b-24a3-4512-8859-80f29700a5b8 admin admin] Calling method '>' {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:53.799469 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-83308d0b-24a3-4512-8859-80f29700a5b8 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002222 May 19 06:23:53.799864 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 30/61] 10.222.0.65 () {56 vars in 1074 bytes} [Thu May 19 06:23:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:23:53.987768 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-9ec5126a-3d1d-4e72-ad9a-ed5a6e02045b admin admin] Calling method '>' {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:23:54.007842 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-9ec5126a-3d1d-4e72-ad9a-ed5a6e02045b admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072540 May 19 06:23:54.008320 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 32/62] 10.222.0.65 () {60 vars in 1202 bytes} [Thu May 19 06:23:53 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:24:56.785429 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-83308d0b-24a3-4512-8859-80f29700a5b8 admin admin] Calling method '>' {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:24:56.786440 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-83308d0b-24a3-4512-8859-80f29700a5b8 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 May 19 06:24:56.786836 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 31/63] 10.222.0.65 () {54 vars in 930 bytes} [Thu May 19 06:24:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:24:56.794208 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG dbcounter [-] [102983] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=102983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:24:56.848506 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-48d1a422-79e4-4685-a86d-848c75e30136 admin admin] Calling method '>' {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:24:56.868415 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-48d1a422-79e4-4685-a86d-848c75e30136 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075678 May 19 06:24:56.868961 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 33/64] 10.222.0.65 () {60 vars in 1291 bytes} [Thu May 19 06:24:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:24:56.888399 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG dbcounter [-] [102982] Writing DB stats nova_api:SELECT=14 {{(pid=102982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:24:56.892359 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-1c9c16a5-9c77-4d32-b19e-4d6b067032ed admin admin] Calling method '>' {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:24:56.900272 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-1c9c16a5-9c77-4d32-b19e-4d6b067032ed admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013327 May 19 06:24:56.900811 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 32/65] 10.222.0.65 () {60 vars in 1282 bytes} [Thu May 19 06:24:56 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:24:56.913098 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-26a48945-2e99-4130-ac8b-5d0bb3bdfbeb admin admin] Calling method '>' {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:24:56.920774 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-26a48945-2e99-4130-ac8b-5d0bb3bdfbeb admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011313 May 19 06:24:56.922279 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 34/66] 10.222.0.65 () {60 vars in 1285 bytes} [Thu May 19 06:24:56 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:24:56.933504 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-7929f89f-265c-4117-958f-e997946aaf81 admin admin] Calling method '>' {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:24:56.941368 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-7929f89f-265c-4117-958f-e997946aaf81 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011526 May 19 06:24:56.941904 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 33/67] 10.222.0.65 () {60 vars in 1285 bytes} [Thu May 19 06:24:56 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:24:56.953532 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-0d987f24-333f-4b34-82da-56fd6928aef2 admin admin] Calling method '>' {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:24:56.961315 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-0d987f24-333f-4b34-82da-56fd6928aef2 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011700 May 19 06:24:56.961846 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 35/68] 10.222.0.65 () {60 vars in 1282 bytes} [Thu May 19 06:24:56 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:28:29.096009 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-7929f89f-265c-4117-958f-e997946aaf81 admin admin] Calling method '>' {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:28:29.097012 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-7929f89f-265c-4117-958f-e997946aaf81 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 May 19 06:28:29.097430 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 34/69] 10.222.0.65 () {56 vars in 1074 bytes} [Thu May 19 06:28:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:28:29.261465 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG dbcounter [-] [102983] Writing DB stats nova_api:SELECT=6 {{(pid=102983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:28:29.378443 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-65a6c471-c009-4024-9ce9-cbda220bcd99 admin admin] Calling method '>' {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:28:29.379595 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 06:28:29.379595 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: warnings.warn(msg) May 19 06:28:29.380989 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG oslo_concurrency.lockutils [None req-65a6c471-c009-4024-9ce9-cbda220bcd99 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:28:29.381587 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG oslo_concurrency.lockutils [None req-65a6c471-c009-4024-9ce9-cbda220bcd99 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:28:29.382392 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG oslo_concurrency.lockutils [None req-65a6c471-c009-4024-9ce9-cbda220bcd99 admin admin] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:28:29.382818 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG oslo_concurrency.lockutils [None req-65a6c471-c009-4024-9ce9-cbda220bcd99 admin admin] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:28:29.418357 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-65a6c471-c009-4024-9ce9-cbda220bcd99 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.158280 May 19 06:28:29.418927 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 36/70] 10.222.0.65 () {60 vars in 1193 bytes} [Thu May 19 06:28:29 2022] GET /compute/v2.1/os-services => generated 794 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 06:28:30.357313 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-7929f89f-265c-4117-958f-e997946aaf81 admin admin] Calling method '>' {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:28:30.358331 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-7929f89f-265c-4117-958f-e997946aaf81 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 19 06:28:30.358730 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 35/71] 10.222.0.65 () {56 vars in 1074 bytes} [Thu May 19 06:28:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:28:30.548577 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-11c43754-43e0-4640-8d45-29cf4662d83f admin admin] Calling method '>' {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:28:30.549791 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 06:28:30.549791 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: warnings.warn(msg) May 19 06:28:30.551005 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG oslo_concurrency.lockutils [None req-11c43754-43e0-4640-8d45-29cf4662d83f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:28:30.551445 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG oslo_concurrency.lockutils [None req-11c43754-43e0-4640-8d45-29cf4662d83f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:28:30.552220 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG oslo_concurrency.lockutils [None req-11c43754-43e0-4640-8d45-29cf4662d83f admin admin] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:28:30.552646 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG oslo_concurrency.lockutils [None req-11c43754-43e0-4640-8d45-29cf4662d83f admin admin] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:28:30.572541 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-11c43754-43e0-4640-8d45-29cf4662d83f admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.075527 May 19 06:28:30.573096 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 37/72] 10.222.0.65 () {60 vars in 1193 bytes} [Thu May 19 06:28:30 2022] GET /compute/v2.1/os-services => generated 794 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 06:28:41.887204 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-7929f89f-265c-4117-958f-e997946aaf81 admin admin] Calling method '>' {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:28:41.888213 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-7929f89f-265c-4117-958f-e997946aaf81 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 May 19 06:28:41.888613 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 36/73] 10.222.0.65 () {56 vars in 1074 bytes} [Thu May 19 06:28:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:28:42.034446 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG dbcounter [-] [102983] Writing DB stats nova_cell0:SELECT=4 {{(pid=102983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:28:42.035168 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG dbcounter [-] [102983] Writing DB stats nova_cell1:SELECT=4 {{(pid=102983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:28:42.035818 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG dbcounter [-] [102983] Writing DB stats nova_api:SELECT=8 {{(pid=102983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:28:42.087676 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-83163e9c-0fe4-491f-abd8-15110b86c498 admin admin] Calling method '>' {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:28:42.089807 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 06:28:42.089807 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: warnings.warn(msg) May 19 06:28:42.091028 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG oslo_concurrency.lockutils [None req-83163e9c-0fe4-491f-abd8-15110b86c498 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:28:42.091470 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG oslo_concurrency.lockutils [None req-83163e9c-0fe4-491f-abd8-15110b86c498 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:28:42.092249 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG oslo_concurrency.lockutils [None req-83163e9c-0fe4-491f-abd8-15110b86c498 admin admin] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:28:42.092674 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG oslo_concurrency.lockutils [None req-83163e9c-0fe4-491f-abd8-15110b86c498 admin admin] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:28:42.117750 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-83163e9c-0fe4-491f-abd8-15110b86c498 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.087880 May 19 06:28:42.118228 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 38/74] 10.222.0.65 () {60 vars in 1193 bytes} [Thu May 19 06:28:42 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:28:43.031705 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: DEBUG nova.api.openstack.wsgi [None req-7929f89f-265c-4117-958f-e997946aaf81 admin admin] Calling method '>' {{(pid=102982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:28:43.032719 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: INFO nova.api.openstack.requestlog [None req-7929f89f-265c-4117-958f-e997946aaf81 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001725 May 19 06:28:43.033148 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: [pid: 102982|app: 0|req: 37/75] 10.222.0.65 () {56 vars in 1074 bytes} [Thu May 19 06:28:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:28:43.224318 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG nova.api.openstack.wsgi [None req-5c557bc8-7244-468a-8f6e-c890f84e6192 admin admin] Calling method '>' {{(pid=102983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:28:43.225517 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 06:28:43.225517 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: warnings.warn(msg) May 19 06:28:43.226696 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG oslo_concurrency.lockutils [None req-5c557bc8-7244-468a-8f6e-c890f84e6192 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:28:43.227136 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG oslo_concurrency.lockutils [None req-5c557bc8-7244-468a-8f6e-c890f84e6192 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:28:43.227908 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG oslo_concurrency.lockutils [None req-5c557bc8-7244-468a-8f6e-c890f84e6192 admin admin] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:28:43.228336 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: DEBUG oslo_concurrency.lockutils [None req-5c557bc8-7244-468a-8f6e-c890f84e6192 admin admin] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:28:43.251140 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: INFO nova.api.openstack.requestlog [None req-5c557bc8-7244-468a-8f6e-c890f84e6192 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.080003 May 19 06:28:43.251639 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: [pid: 102983|app: 0|req: 39/76] 10.222.0.65 () {60 vars in 1193 bytes} [Thu May 19 06:28:43 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:29:41.168676 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: Thu May 19 06:29:41 2022 - graceful shutdown triggered... May 19 06:29:41.168817 dv-cinder-836996-22-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 19 06:29:41.169784 dv-cinder-836996-22-iscsi devstack@n-api.service[102982]: Gracefully killing worker 1 (pid: 102982)... May 19 06:29:41.170172 dv-cinder-836996-22-iscsi devstack@n-api.service[102983]: Gracefully killing worker 2 (pid: 102983)... May 19 06:29:42.170111 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: worker 1 buried after 1 seconds May 19 06:29:42.170111 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: worker 2 buried after 1 seconds May 19 06:29:42.170111 dv-cinder-836996-22-iscsi devstack@n-api.service[102981]: goodbye to uWSGI. May 19 06:29:42.171771 dv-cinder-836996-22-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 19 06:29:42.172324 dv-cinder-836996-22-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 19 06:29:42.175053 dv-cinder-836996-22-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 19 06:29:42.187730 dv-cinder-836996-22-iscsi devstack@n-api.service[117697]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 19 06:29:42.204829 dv-cinder-836996-22-iscsi devstack@n-api.service[117697]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 06:29:42 2022] *** May 19 06:29:42.204829 dv-cinder-836996-22-iscsi devstack@n-api.service[117697]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 06:29:42.204829 dv-cinder-836996-22-iscsi devstack@n-api.service[117697]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 06:29:42.204829 dv-cinder-836996-22-iscsi devstack@n-api.service[117697]: nodename: dv-cinder-836996-22-iscsi May 19 06:29:42.204829 dv-cinder-836996-22-iscsi devstack@n-api.service[117697]: machine: x86_64 May 19 06:29:42.204829 dv-cinder-836996-22-iscsi devstack@n-api.service[117697]: clock source: unix May 19 06:29:42.204829 dv-cinder-836996-22-iscsi devstack@n-api.service[117697]: pcre jit disabled May 19 06:29:42.204829 dv-cinder-836996-22-iscsi devstack@n-api.service[117697]: detected number of CPU cores: 4 May 19 06:29:42.205853 dv-cinder-836996-22-iscsi devstack@n-api.service[117697]: current working directory: / May 19 06:29:42.205853 dv-cinder-836996-22-iscsi devstack@n-api.service[117697]: detected binary path: /usr/bin/uwsgi-core May 19 06:29:42.205853 dv-cinder-836996-22-iscsi devstack@n-api.service[117697]: your processes number limit is 47680 May 19 06:29:42.205853 dv-cinder-836996-22-iscsi devstack@n-api.service[117697]: your memory page size is 4096 bytes May 19 06:29:42.205853 dv-cinder-836996-22-iscsi devstack@n-api.service[117697]: detected max file descriptor number: 2048 May 19 06:29:42.205853 dv-cinder-836996-22-iscsi devstack@n-api.service[117697]: lock engine: pthread robust mutexes May 19 06:29:42.205853 dv-cinder-836996-22-iscsi devstack@n-api.service[117697]: thunder lock: enabled May 19 06:29:42.205853 dv-cinder-836996-22-iscsi devstack@n-api.service[117697]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 19 06:29:42.205853 dv-cinder-836996-22-iscsi devstack@n-api.service[117697]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 06:29:42.258381 dv-cinder-836996-22-iscsi devstack@n-api.service[117697]: Python main interpreter initialized at 0x55ecae3da9c0 May 19 06:29:42.258381 dv-cinder-836996-22-iscsi devstack@n-api.service[117697]: python threads support enabled May 19 06:29:42.258381 dv-cinder-836996-22-iscsi devstack@n-api.service[117697]: your server socket listen backlog is limited to 100 connections May 19 06:29:42.258381 dv-cinder-836996-22-iscsi devstack@n-api.service[117697]: your mercy for graceful operations on workers is 90 seconds May 19 06:29:42.258826 dv-cinder-836996-22-iscsi devstack@n-api.service[117697]: mapped 403077 bytes (393 KB) for 2 cores May 19 06:29:42.258826 dv-cinder-836996-22-iscsi devstack@n-api.service[117697]: *** Operational MODE: preforking *** May 19 06:29:42.259093 dv-cinder-836996-22-iscsi devstack@n-api.service[117697]: *** uWSGI is running in multiple interpreter mode *** May 19 06:29:42.259093 dv-cinder-836996-22-iscsi devstack@n-api.service[117697]: spawned uWSGI master process (pid: 117697) May 19 06:29:42.259328 dv-cinder-836996-22-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 19 06:29:42.259895 dv-cinder-836996-22-iscsi devstack@n-api.service[117697]: spawned uWSGI worker 1 (pid: 117711, cores: 1) May 19 06:29:42.260278 dv-cinder-836996-22-iscsi devstack@n-api.service[117697]: spawned uWSGI worker 2 (pid: 117712, cores: 1) May 19 06:29:42.260415 dv-cinder-836996-22-iscsi devstack@n-api.service[117697]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 06:29:43.533984 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 06:29:43.802795 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 06:29:44.360294 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 06:29:44.360294 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: from cryptography.utils import int_from_bytes May 19 06:29:44.360780 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 06:29:44.360780 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: from cryptography.utils import int_from_bytes May 19 06:29:44.535761 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 06:29:44.535761 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: from cryptography.utils import int_from_bytes May 19 06:29:44.536194 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 06:29:44.536194 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: from cryptography.utils import int_from_bytes May 19 06:29:46.879051 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 06:29:46.879645 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 06:29:46.879953 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 06:29:46.880152 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 06:29:46.880406 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 06:29:46.880812 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.881150 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.881509 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.881841 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.882184 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.882503 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.882845 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.883178 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.883523 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.883788 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.884114 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.884462 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-22-iscsi {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.885347 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.885678 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.886002 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.886337 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.886646 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.886981 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.887298 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.887809 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.889328 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.889328 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.889328 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.889328 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.889708 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.890510 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.890510 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.890728 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.890958 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.891256 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.891669 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-22-iscsi {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.891996 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.892309 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.892636 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.893072 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.893431 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.893750 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.894080 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.894414 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.894895 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.895091 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.895403 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.895734 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.896050 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.896353 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.896684 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.896983 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.897329 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.897650 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.897964 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.898223 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.898552 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.898881 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.899216 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.899539 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.899786 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.900044 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.900388 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.901367 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.901916 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.902407 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.902736 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.903062 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.903385 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.903704 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.904022 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.904339 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.904671 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.904996 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.905349 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.905670 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.906250 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.906732 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.906927 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.907244 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.907595 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.908070 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.908250 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.908563 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.908997 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.909337 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.909529 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.909845 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.910170 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.910512 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.910825 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.911083 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.911391 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.911703 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.912028 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.912341 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.912652 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.912967 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.913355 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.913618 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.913931 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.914241 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.914552 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.914866 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.915173 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.915483 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.915795 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.916267 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.916779 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.917112 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.917457 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.917769 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.918081 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.918395 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.918726 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.919142 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.919429 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.919665 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.919978 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.920290 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.920616 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.920928 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.921241 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.921591 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.921901 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.922215 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.922540 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.922852 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.923174 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.923489 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.924113 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.924113 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.924435 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.924716 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.924999 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.925316 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.925650 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.925980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.926296 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.926766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.926920 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.927227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:46.927776 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.927952 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.928240 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.928563 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.928906 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.929246 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.929613 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.929935 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.930260 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.930596 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.930918 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.931236 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.931556 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.932545 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.932857 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.933426 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.933618 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.933921 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.934241 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.934603 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.937393 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.937393 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.937393 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.937393 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.937393 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.938172 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.938172 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.939020 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.939416 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.939976 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.940509 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.941433 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.941433 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.941655 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.941864 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.942284 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.942840 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.943402 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.943770 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.944078 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.944381 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.944735 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.945063 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.945427 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.945752 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.946080 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.946403 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.946724 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.947044 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.948003 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.948324 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.948981 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.948981 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.949563 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.949675 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.949942 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.950257 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.950600 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.950915 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.951234 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.951554 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.951873 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.952188 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.952532 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.952827 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.953145 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.953502 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.953825 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.954136 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.954469 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.954785 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.955092 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.955417 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.955737 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.956051 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.956373 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.956686 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.957016 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.957358 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.957680 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.958021 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.958360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.958709 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.959125 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.959336 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.959718 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.959960 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.960278 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.960592 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.960902 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.961214 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.961557 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.961870 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.962181 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.962490 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.962802 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.963232 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.964638 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.964638 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.964638 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.965113 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.965113 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.965417 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.965737 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.966090 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.966436 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.966766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.967100 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.967425 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.967751 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.968073 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.968394 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.968714 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.969346 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.969465 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.969688 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.970025 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.970330 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.970658 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.970975 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.971305 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.971617 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.971941 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.972287 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.972627 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.972956 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.973306 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.973623 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.973943 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.974302 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.974579 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.974896 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.975217 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.975539 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.975855 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.976179 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.976498 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.976825 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.977141 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.977500 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.977814 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.978134 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.978469 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.978894 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.979268 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.979624 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.980034 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.980315 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.980583 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.980900 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.981212 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.981552 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.981867 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.982188 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.982505 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.982824 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.983136 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.983459 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.983775 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.984087 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.984399 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.984714 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.985043 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.985389 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.985704 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.986032 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.986345 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.986656 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.986984 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.987299 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.987607 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.987917 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.988224 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.988570 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.988891 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.989276 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.989706 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.989848 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.990167 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.990488 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.990800 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.991114 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.991441 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.991760 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.992563 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.992563 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.992855 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.992992 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.993312 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.993643 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.993958 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.994935 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.995507 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.995980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.996250 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.996583 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.997175 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.997565 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.997894 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.998224 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.998555 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.998883 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.999221 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:46.999874 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.000027 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.000252 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.000627 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.000894 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.001135 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.001476 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.001789 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.002102 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.002413 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.002734 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.003046 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.003356 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.003667 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.003979 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.004301 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.004610 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.004933 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.005241 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.005612 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.006414 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.006414 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.006780 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.006921 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.007156 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.007469 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.007816 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.008151 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.008946 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.008946 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.009224 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.009443 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.009812 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.010827 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.011044 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.011699 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.011699 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.012005 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.012259 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.012579 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.012902 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.013218 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.013552 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.013867 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.014178 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.014503 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.014818 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.015127 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.015942 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.015942 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.016251 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.016428 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.016685 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.016948 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.017240 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.017594 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.017907 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.018217 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.018534 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.018849 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.019157 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.019489 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.019888 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.020117 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.020429 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.020889 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.021068 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.021368 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.021685 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.022018 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.022344 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.022656 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.022977 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.023287 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.023598 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.023908 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.024222 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.024552 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.025321 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.025321 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.025570 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.026460 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.026460 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.026460 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.026773 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.027275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.027397 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.027745 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.028056 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.028422 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.028736 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.029058 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.029408 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.029732 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.030051 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.030373 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.030928 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.031262 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.031578 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.031898 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.032209 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.032518 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.032852 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.033170 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.033511 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.033845 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.034698 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.034698 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.034893 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.035102 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.035416 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.035732 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.036050 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.036363 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.036679 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.036995 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.037328 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.037648 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.037966 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.038278 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.038592 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.038914 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.039224 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.039558 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.039866 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.040177 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.040487 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.040798 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.041202 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.041515 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.041961 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.042280 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.042600 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.042909 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.043226 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.043543 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.043878 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.044185 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.044495 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.044920 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.045240 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.045581 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.045901 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.046212 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.046525 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.046841 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.047171 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.047483 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.047793 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.048103 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.048431 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.048742 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.049069 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.049544 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.049886 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.050216 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.050632 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.050951 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.051274 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.051599 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.051933 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.052262 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.052581 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.052901 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.053219 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.053574 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.053906 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.055299 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.055299 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.055299 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.055299 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.055637 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.055765 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.056094 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.056526 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.057422 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.057730 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.058703 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.058894 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 06:29:47.059331 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.059435 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 06:29:47.059523 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.059523 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.059678 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 06:29:47.059775 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.059869 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 06:29:47.059961 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.060046 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 06:29:47.060136 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.060229 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.060326 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.060554 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.060691 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.060794 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.060883 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.061073 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.061234 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.061444 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.061539 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.061757 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.061858 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.062068 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.062162 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.062388 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.062488 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.062697 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.062789 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.062964 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.063056 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.063279 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.063371 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.063606 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-22-iscsi {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.063705 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.063933 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.064041 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.064241 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.064333 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.064622 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.064743 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.064869 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.064969 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.065174 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.065273 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.065506 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.065623 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.065817 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.065909 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.066172 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.066329 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.066506 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.066676 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.066825 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.066934 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.067113 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.067208 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.067447 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.067542 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.067765 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.067868 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.068104 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.068205 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.068420 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.068537 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.068788 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.068893 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.069046 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.069146 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.069384 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.069482 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.069698 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.069798 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-22-iscsi {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.070010 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.070112 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.070326 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.070425 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.070639 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.070758 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.070947 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.071064 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.071257 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.071361 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.071571 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.071664 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.071881 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.071983 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.072191 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.072915 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.073236 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.073350 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.073591 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.073694 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.073913 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.074006 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.074233 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.074405 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.074659 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.074785 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.074879 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.074978 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.075137 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.075240 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.075445 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.075544 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.075764 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.075856 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.076071 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.076178 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.076377 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.076479 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.076633 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.076797 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.076945 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.077108 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.077267 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.077395 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.077585 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.077686 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.077913 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.078018 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.078167 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.078308 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.078408 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.078631 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.078734 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.078956 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.079062 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.079277 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.079378 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.079596 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.079705 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.079909 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.080000 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.080219 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.080331 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.080523 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.080641 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.080826 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.080916 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.081148 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.081240 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.081463 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.081566 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.081781 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.082057 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.082148 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.082395 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.082521 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.082698 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.082805 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.083015 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.083119 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.083341 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.083436 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.083646 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.083738 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.083954 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.084046 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.084353 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.084467 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.084622 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.084729 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.084919 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.085040 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.085200 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.085326 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.085542 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.085635 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.085851 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.085998 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.086160 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.086261 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.086468 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.086569 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.086789 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.086907 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.087123 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.087224 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.087428 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.087522 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.087685 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.087792 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.088107 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.088255 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.088438 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.088542 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.088748 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.088849 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.089056 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.089164 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.089392 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.089510 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.089698 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.089793 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.090000 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.090102 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.090309 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.090403 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.090617 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.090711 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.090932 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.091096 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.091235 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.091452 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.091611 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.091807 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.091960 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.092077 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.092198 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.092314 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.092474 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.092708 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.092861 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.093010 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.093151 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.093389 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.093485 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.093579 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.093665 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.093756 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.093934 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.094038 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.094237 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.094543 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.094647 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.094922 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.095037 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.095164 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.095253 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.095472 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.095571 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.095791 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.095881 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.096099 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.096193 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.096401 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.096520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.097510 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.097676 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.097806 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.097898 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.098000 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.098093 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.098178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.098262 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.098345 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.098429 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.098523 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.098617 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.098702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.098785 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.098869 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.098956 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.099288 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.099414 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.099511 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.099604 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.099699 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.099863 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.099989 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.100290 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.100394 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.100592 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.100713 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.100896 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.101106 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.101272 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.101416 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.101576 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.101697 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.101942 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.102059 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.102208 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.102303 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.102514 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.102672 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.102819 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.102951 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.103136 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 06:29:47.103271 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.103473 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.103742 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.103839 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.104155 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.104257 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.104586 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.104694 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.104792 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.104885 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.105085 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.105192 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.105420 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.105531 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.105735 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.105838 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.106047 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.106140 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.106356 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.106458 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.106670 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.106769 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.106980 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.107074 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.107287 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.107394 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.107597 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.107692 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.107912 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.108031 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.108222 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.108451 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.108552 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.108640 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.108828 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.108922 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.109136 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.109264 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.109480 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.109586 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.109788 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.109883 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.110105 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.110200 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.110417 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.110519 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.110727 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.110827 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.111037 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.111165 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.111478 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.111622 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.111766 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.111905 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.112194 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.112358 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.112358 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.112644 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.112793 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.112941 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.112941 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.113242 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.113376 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.113465 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.113550 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.113649 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.113853 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.113955 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.114164 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.114262 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.114482 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.114583 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.114793 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.114885 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.115104 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.115360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.115464 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.115699 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.115793 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.116004 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.116095 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.116339 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.116439 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.116654 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.116746 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.116969 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.117068 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.117295 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.117405 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.117618 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.117711 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.117928 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.118019 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.118238 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.118358 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.118550 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.118661 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.118855 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.118953 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.119700 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.119831 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.120025 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.120128 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.120378 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.120520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.120683 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.120842 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.121006 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.121160 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.121369 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.121489 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.121678 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.121812 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.122012 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.122132 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.122318 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.122450 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.122632 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.122780 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.122940 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.123106 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.123250 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.123433 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.123557 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.123767 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.123861 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.124092 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.124192 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.124414 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.124517 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.124732 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.124826 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.125049 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.125148 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.125382 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.125488 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.125694 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.125799 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.125997 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.126088 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.126302 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.126397 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.126616 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.126716 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.126927 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.127020 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.127236 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.127363 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.127547 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.127684 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.127861 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.128009 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.128184 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.128337 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.128496 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.128654 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.128806 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.128983 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.129186 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.129324 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.129491 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.129639 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.129836 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.130007 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.130101 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.130270 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.130424 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.130607 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.130737 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.130957 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.131052 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.131312 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.131412 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.131626 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.131733 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.131929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.132021 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.132236 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.132428 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.132532 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.132636 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.132829 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.132926 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.133132 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.133224 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.133459 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.133566 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.133763 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.133868 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.134081 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.134177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.134396 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.134498 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.134706 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.134854 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.135711 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.135824 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.136020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.136154 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.136328 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.136473 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.136684 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.136784 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.136996 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.137097 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.137365 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.137474 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.137706 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.137800 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.138016 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.138109 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.138329 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.138437 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.138640 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.138729 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.138957 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.139038 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.139284 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.139387 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.139569 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.139672 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.139888 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.139989 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.140189 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.140294 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.140494 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.140598 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.140804 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.140896 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.141125 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.141227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.141464 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.141563 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.141790 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.141882 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.142103 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.142211 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.142425 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.142524 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.142730 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.142822 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.143048 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.143150 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.143373 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.143472 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.143723 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.143891 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.144011 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.144114 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.144331 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.144422 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.144641 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.144735 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.144956 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.145050 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.145267 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.145406 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.145641 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.145746 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.145913 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.146006 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.146226 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.146323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.146544 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.146626 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.147260 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.147344 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.147813 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.147921 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.147998 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.148080 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.148164 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.148244 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.148318 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.148396 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.148478 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.148550 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.148668 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.148760 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.148982 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.149064 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.149462 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.149555 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.149655 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.149750 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.149969 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.150053 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.150318 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.150417 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.151331 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.151465 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.151564 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.151651 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.151744 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.152017 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.152129 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.152323 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.152522 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.152619 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.152713 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.152924 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.153032 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.153237 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.153352 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.153574 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.153694 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.153906 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.154061 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.154185 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.154385 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.154502 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.154739 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.154849 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.155077 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.155170 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.155393 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.155483 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.156009 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.156130 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.156266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.156359 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.156517 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 06:29:47.156612 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.156886 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.157208 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.157538 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.157851 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.158175 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.158486 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.158789 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.159092 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.159472 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.159735 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.160045 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.160348 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.160666 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.160985 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.161309 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.161629 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.161957 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.162248 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.162567 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.162883 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.163193 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.163503 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.163815 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.164128 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.164435 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.164759 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.165068 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.165412 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.165725 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.166767 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.166950 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.167272 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.167875 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.168214 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.168532 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.168853 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.169173 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.169627 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.169852 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.170181 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.170527 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.170835 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.171146 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.171454 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.171756 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.172067 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.172371 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.172676 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.172981 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.173301 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.173620 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.173924 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.174227 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.174532 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.174849 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.175153 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.175464 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.175766 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.176093 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.176400 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.176705 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.177015 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.177401 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.177754 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.178059 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.178399 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.178725 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.179067 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.179373 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.179681 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.180004 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.180306 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.180608 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.180909 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.181217 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.181552 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.181889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.182200 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.182509 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.182815 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.183120 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.183421 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.183728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.184030 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.184345 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.184651 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.184952 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.185251 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.185582 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.185888 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.186190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.186500 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.186798 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.187111 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.187415 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.187726 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.188028 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.188335 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.188641 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.188940 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.189263 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.189593 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.189895 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.190196 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.190502 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.190803 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.191102 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.191409 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.191727 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.192041 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.192345 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.192649 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.192951 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.193252 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.193578 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.193884 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.194183 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.194484 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.194783 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.195084 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.195384 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.195705 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.196011 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.196313 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.196615 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.196912 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.197485 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.197689 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.197948 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.198253 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.198573 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.198888 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.199199 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.199509 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.199820 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.200123 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.200439 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.200751 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.201064 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.201394 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.201701 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.202021 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.202335 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.202645 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.202967 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.203289 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.203613 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.203920 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.204227 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.204537 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.204860 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.205153 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.205494 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.205811 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.206125 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.206436 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.206749 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.207060 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.207368 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.207678 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.207986 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.208289 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.208613 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.208920 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.209222 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.209556 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.209859 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.210167 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.210469 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.210905 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.211216 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.211526 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.211830 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.212140 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.212452 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.212765 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.213613 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.213935 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.214335 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.214646 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.214955 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.215264 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.215566 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.215869 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.216177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.216498 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.216805 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.217106 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.217435 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.217757 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.218061 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.218300 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO dbcounter [None req-e1652e89-67b8-4b01-a332-a85b55ba8a75 None None] Registered counter for database nova_api May 19 06:29:47.218399 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.218782 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.219097 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.219402 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.219818 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.220128 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.220438 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.220787 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.221110 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.221458 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.221765 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.222082 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.222392 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.222718 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.223039 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.223347 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.223668 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.223969 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.224292 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.224613 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.224926 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.225247 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.225690 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.226015 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.226329 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.226654 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.226981 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.227285 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.227596 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.227905 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.228208 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.228540 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.229406 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.229717 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.230033 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.230336 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.230650 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.230956 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.231254 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.231581 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.231880 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.232204 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.232515 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.232840 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.233162 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.233489 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.233813 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.235086 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.235086 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.235086 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.235086 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.235397 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.235623 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.235983 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.236288 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.236597 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.237040 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.237239 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.238218 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.238218 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.238218 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.238819 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.238819 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.239123 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.240113 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.240113 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.240331 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_db.sqlalchemy.engines [None req-e1652e89-67b8-4b01-a332-a85b55ba8a75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117712) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 06:29:47.240424 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.240424 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.240640 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.240878 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.241179 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.241509 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.241830 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.242135 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.242458 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.242884 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.243058 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.243360 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.243663 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.244243 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.244679 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.244679 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.244970 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.245524 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.245859 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.246171 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.246495 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.246811 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.247218 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.247608 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.248012 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.248283 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.248450 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.248657 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.248823 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writer thread running {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 06:29:47.249180 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.249384 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.249691 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.249908 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.250471 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.250804 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.251121 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.251437 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.251750 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.252062 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.252375 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.252690 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.252999 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.253331 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.253644 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.253973 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.254294 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.254619 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.254958 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.255269 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.255583 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.255896 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.256208 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.256563 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.256876 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.257180 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.257520 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.257832 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.258143 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.258451 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.258759 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.259071 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.259381 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.259689 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.260636 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.260958 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.261270 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.261619 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.261954 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.262274 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.262587 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.262904 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.263220 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.263754 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.264071 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.264407 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.264735 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.265066 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.265398 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.265720 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.266050 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.266361 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.266667 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.266978 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.267289 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.267599 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.267919 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.268231 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.268532 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.268852 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.269160 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.269718 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.270065 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.270380 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.270705 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.271032 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.271347 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.271657 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.271978 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.272285 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.272592 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.272909 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.273223 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.273580 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.273856 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.274164 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.274471 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.274773 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.275088 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.275413 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.276256 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.276560 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.276862 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.277164 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.277500 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.277812 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.278112 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.278420 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.278721 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.279031 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.279336 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.279646 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.279950 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.280260 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.280633 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.281237 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.281522 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.281847 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.282152 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.282454 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.282771 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.283083 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.283404 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.283719 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.284028 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.284377 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.284689 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.285237 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.285671 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.285918 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.286250 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.286580 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.286891 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.287270 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.287500 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.287831 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.288141 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.288450 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.288759 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.289070 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.289401 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.289729 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.290041 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.290327 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.290634 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.290970 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.291674 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.291674 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.291882 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.292203 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.292520 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.292832 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.293150 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.293491 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.293938 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.294118 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.294404 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.294710 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.295028 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.295355 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.295670 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.295972 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.296401 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.296714 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.297030 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.297372 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.297687 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.298012 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.298331 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.298815 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.299030 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.299252 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.299558 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.299897 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.300222 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.300550 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.300854 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.301159 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.301487 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.301797 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.302119 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.302422 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.303127 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.303127 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.303553 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.303767 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.304140 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.304140 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.304921 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.304921 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.305443 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.305443 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.306030 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.306030 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.306442 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.306677 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.306892 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.context [None req-e1652e89-67b8-4b01-a332-a85b55ba8a75 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3c468ea9-4daa-4cd8-93b7-4e256fd82cc9(cell1) {{(pid=117712) load_cells /opt/stack/nova/nova/context.py:464}} May 19 06:29:47.307117 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.307117 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.307443 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.307730 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.308030 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.308333 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.308665 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.308996 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.309325 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.309645 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.309954 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.310274 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.310580 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.310899 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.311218 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.311447 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e1652e89-67b8-4b01-a332-a85b55ba8a75 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:29:47.311679 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.311886 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.312142 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.312450 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.312758 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.312985 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e1652e89-67b8-4b01-a332-a85b55ba8a75 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:29:47.313203 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.313476 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.313673 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e1652e89-67b8-4b01-a332-a85b55ba8a75 None None] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:29:47.313866 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.314123 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.314438 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.314663 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.314886 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.315205 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.315519 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.315734 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e1652e89-67b8-4b01-a332-a85b55ba8a75 None None] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:29:47.315972 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.316317 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.316525 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.316746 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.317047 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.317378 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.317592 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO dbcounter [None req-e1652e89-67b8-4b01-a332-a85b55ba8a75 None None] Registered counter for database nova_cell0 May 19 06:29:47.317777 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.317996 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.318295 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.318611 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.319010 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.319253 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.319580 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.319886 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.320202 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.320525 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.320871 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.321183 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.321553 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.321881 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.322198 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.323069 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.323314 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 06:29:47.323662 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 06:29:47.326101 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO dbcounter [None req-e1652e89-67b8-4b01-a332-a85b55ba8a75 None None] Registered counter for database nova_cell1 May 19 06:29:47.333184 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_db.sqlalchemy.engines [None req-e1652e89-67b8-4b01-a332-a85b55ba8a75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117712) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 06:29:47.339854 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writer thread running {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 06:29:47.340505 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_db.sqlalchemy.engines [None req-e1652e89-67b8-4b01-a332-a85b55ba8a75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117712) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 06:29:47.385346 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO dbcounter [None req-d69fe9fa-2cc5-4c82-8945-4c21464cd2ab None None] Registered counter for database nova_api May 19 06:29:47.405659 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_db.sqlalchemy.engines [None req-d69fe9fa-2cc5-4c82-8945-4c21464cd2ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117711) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 06:29:47.412510 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writer thread running {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 06:29:47.470128 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.context [None req-d69fe9fa-2cc5-4c82-8945-4c21464cd2ab None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3c468ea9-4daa-4cd8-93b7-4e256fd82cc9(cell1) {{(pid=117711) load_cells /opt/stack/nova/nova/context.py:464}} May 19 06:29:47.474603 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d69fe9fa-2cc5-4c82-8945-4c21464cd2ab None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:29:47.476191 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d69fe9fa-2cc5-4c82-8945-4c21464cd2ab None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:29:47.476967 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d69fe9fa-2cc5-4c82-8945-4c21464cd2ab None None] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:29:47.479613 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d69fe9fa-2cc5-4c82-8945-4c21464cd2ab None None] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:29:47.481651 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO dbcounter [None req-d69fe9fa-2cc5-4c82-8945-4c21464cd2ab None None] Registered counter for database nova_cell0 May 19 06:29:47.485877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO dbcounter [None req-d69fe9fa-2cc5-4c82-8945-4c21464cd2ab None None] Registered counter for database nova_cell1 May 19 06:29:47.487106 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writer thread running {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 06:29:47.493209 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_db.sqlalchemy.engines [None req-d69fe9fa-2cc5-4c82-8945-4c21464cd2ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117711) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 06:29:47.495717 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_db.sqlalchemy.engines [None req-d69fe9fa-2cc5-4c82-8945-4c21464cd2ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117711) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 06:29:47.498274 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO dbcounter [None req-e1652e89-67b8-4b01-a332-a85b55ba8a75 None None] Registered counter for database nova_cell0 May 19 06:29:47.502038 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writer thread running {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 06:29:47.503332 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writer thread running {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 06:29:47.505134 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_db.sqlalchemy.engines [None req-e1652e89-67b8-4b01-a332-a85b55ba8a75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117712) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 06:29:47.509643 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writer thread running {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 06:29:47.671565 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO dbcounter [None req-d69fe9fa-2cc5-4c82-8945-4c21464cd2ab None None] Registered counter for database nova_cell0 May 19 06:29:47.679487 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_db.sqlalchemy.engines [None req-d69fe9fa-2cc5-4c82-8945-4c21464cd2ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117711) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 06:29:47.685977 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writer thread running {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 06:29:47.863840 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: WARNING keystonemiddleware.auth_token [None req-e1652e89-67b8-4b01-a332-a85b55ba8a75 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 06:29:47.871808 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: WARNING keystonemiddleware.auth_token [None req-e1652e89-67b8-4b01-a332-a85b55ba8a75 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 06:29:48.030041 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: WARNING keystonemiddleware.auth_token [None req-d69fe9fa-2cc5-4c82-8945-4c21464cd2ab None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 06:29:48.038605 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: WARNING keystonemiddleware.auth_token [None req-d69fe9fa-2cc5-4c82-8945-4c21464cd2ab None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 06:29:48.222788 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: WARNING keystonemiddleware.auth_token [None req-e1652e89-67b8-4b01-a332-a85b55ba8a75 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 06:29:48.230127 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: WARNING keystonemiddleware.auth_token [None req-e1652e89-67b8-4b01-a332-a85b55ba8a75 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 06:29:48.235541 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ecae3da9c0 pid: 117712 (default app) May 19 06:29:48.409246 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: WARNING keystonemiddleware.auth_token [None req-d69fe9fa-2cc5-4c82-8945-4c21464cd2ab None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 06:29:48.415499 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: WARNING keystonemiddleware.auth_token [None req-d69fe9fa-2cc5-4c82-8945-4c21464cd2ab None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 06:29:48.421002 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ecae3da9c0 pid: 117711 (default app) May 19 06:30:33.496355 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=3 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:30:33.498765 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=3 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:30:33.500369 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=3 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:30:33.501622 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=3 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:30:34.965727 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=3 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:30:34.971022 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=3 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:30:34.973625 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=3 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:30:34.977464 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=3 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:30:35.731720 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-46937487-9eb1-414c-b838-479c9600c78f tempest-VolumesGetTestJSON-1135948218 tempest-VolumesGetTestJSON-1135948218-project] Action: 'create', calling method: .version_select at 0x7f9af15bd550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1800323030", "metadata": {"Type": "work"}}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:30:36.531700 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-35eed195-d16f-4945-b7a4-f6f6b5963113 tempest-VolumesNegativeTest-1249090744 tempest-VolumesNegativeTest-1249090744-project] Action: 'create', calling method: .version_select at 0x7f9af15733a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1481625762", "metadata": {"Type": "work"}}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:30:36.547095 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-35eed195-d16f-4945-b7a4-f6f6b5963113 tempest-VolumesNegativeTest-1249090744 tempest-VolumesNegativeTest-1249090744-project] Request method failure captured: May 19 06:30:36.547095 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 19 06:30:36.547095 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:30:36.547095 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:30:36.547095 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:30:36.547095 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 122 May 19 06:30:36.547095 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:30:36.547095 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:30:36.547095 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:30:36.547095 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:30:36.547095 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheQK_r5FSbR8QAnWRvfPIs2bxqwd1GsxqMxo7ji7EV_F7zEkWDRfqAOgjSVJH-2Cmby-NiIYdbC-_dTFi__YE6MQOlpuqdfEoBbd-iZ66P-ZeJYQKF6cHnHIG743Cd_jeXGFWssfAOVlYSLyziU0Ml8RirH9Lx__QENiwzhbzqbqr5Q May 19 06:30:36.547095 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:30:36.547095 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:30:36.547095 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:30:36.547095 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:30:36.547095 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:30:36.547095 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:30:36.547095 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: d68c640e4ce049e1b051070692d205f7 May 19 06:30:36.547095 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-VolumesNegativeTest-1249090744 May 19 06:30:36.547095 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:30:36.547095 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:30:36.550513 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d68c640e4ce049e1b051070692d205f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d68c640e4ce049e1b051070692d205f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d68c640e4ce049e1b051070692d205f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d68c640e4ce049e1b051070692d205f7", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:30:36.550513 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-VolumesNegativeTest-1249090744 May 19 06:30:36.550513 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: d68c640e4ce049e1b051070692d205f7 May 19 06:30:36.550513 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-VolumesNegativeTest-1249090744 May 19 06:30:36.550513 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-VolumesNegativeTest-1249090744-project May 19 06:30:36.550513 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:30:36.550513 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:30:36.550513 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: 8a6e7c96b7c54bf89e7cc7f819bcc135 May 19 06:30:36.550513 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-VolumesNegativeTest-1249090744-project May 19 06:30:36.550513 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: May 19 06:30:36.550513 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1481625762", "metadata": {"Type": "work"}}} May 19 06:30:36.550513 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: May 19 06:30:36.550513 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 19 06:30:36.552842 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1481625762', 'metadata': {'Type': 'work'}}}} May 19 06:30:36.552842 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:30:36.552842 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:30:36.552842 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 06:30:36.552842 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 06:30:36.552842 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 06:30:36.552842 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise error May 19 06:30:36.552842 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 19 06:30:36.552842 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:30:36.552842 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 19 06:30:36.552842 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 19 06:30:36.552842 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:30:36.552842 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi On instance['volume']: May 19 06:30:36.552842 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi '#$%' May 19 06:30:36.552842 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:30:36.552842 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:30:36.552842 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:30:36.552842 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:30:36.552842 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:30:36.552842 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:30:36.552842 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:30:36.552842 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:30:36.556374 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 06:30:36.556374 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 06:30:36.556374 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:30:36.556374 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:30:36.556374 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 06:30:36.556374 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 06:30:36.556374 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 06:30:36.556374 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 06:30:36.556374 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 06:30:36.556374 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 06:30:36.556374 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 19 06:30:36.556374 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:30:36.556374 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:30:36.556374 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:30:36.556374 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:30:36.556374 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:30:36.556374 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:30:36.556374 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 06:30:36.556374 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 06:30:36.561870 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 19 06:30:36.561870 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:30:36.561870 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-35eed195-d16f-4945-b7a4-f6f6b5963113 tempest-VolumesNegativeTest-1249090744 tempest-VolumesNegativeTest-1249090744-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:30:36.561870 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-35eed195-d16f-4945-b7a4-f6f6b5963113 tempest-VolumesNegativeTest-1249090744 tempest-VolumesNegativeTest-1249090744-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.612084 May 19 06:30:36.565370 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 1/1] 10.222.0.65 () {60 vars in 1155 bytes} [Thu May 19 06:30:34 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1628 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 06:30:36.573929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5487d396-04ba-4cf0-a3a7-b6ba2edd0bf1 tempest-VolumesNegativeTest-1249090744 tempest-VolumesNegativeTest-1249090744-project] Action: 'create', calling method: .version_select at 0x7f9af14e6700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1589054434", "metadata": {"Type": "work"}}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:30:36.585020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5487d396-04ba-4cf0-a3a7-b6ba2edd0bf1 tempest-VolumesNegativeTest-1249090744 tempest-VolumesNegativeTest-1249090744-project] Request method failure captured: May 19 06:30:36.585020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 19 06:30:36.585020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:30:36.585020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:30:36.585020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:30:36.585020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 120 May 19 06:30:36.585020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:30:36.585020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:30:36.585020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:30:36.585020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:30:36.585020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheQK_r5FSbR8QAnWRvfPIs2bxqwd1GsxqMxo7ji7EV_F7zEkWDRfqAOgjSVJH-2Cmby-NiIYdbC-_dTFi__YE6MQOlpuqdfEoBbd-iZ66P-ZeJYQKF6cHnHIG743Cd_jeXGFWssfAOVlYSLyziU0Ml8RirH9Lx__QENiwzhbzqbqr5Q May 19 06:30:36.585020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:30:36.585020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:30:36.585020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:30:36.585020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:30:36.585020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:30:36.585020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:30:36.585020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: d68c640e4ce049e1b051070692d205f7 May 19 06:30:36.585020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-VolumesNegativeTest-1249090744 May 19 06:30:36.585020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:30:36.585020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:30:36.588756 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d68c640e4ce049e1b051070692d205f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d68c640e4ce049e1b051070692d205f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d68c640e4ce049e1b051070692d205f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d68c640e4ce049e1b051070692d205f7", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:30:36.588756 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-VolumesNegativeTest-1249090744 May 19 06:30:36.588756 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: d68c640e4ce049e1b051070692d205f7 May 19 06:30:36.588756 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-VolumesNegativeTest-1249090744 May 19 06:30:36.588756 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-VolumesNegativeTest-1249090744-project May 19 06:30:36.588756 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:30:36.588756 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:30:36.588756 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: 8a6e7c96b7c54bf89e7cc7f819bcc135 May 19 06:30:36.588756 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-VolumesNegativeTest-1249090744-project May 19 06:30:36.588756 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: May 19 06:30:36.588756 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1589054434", "metadata": {"Type": "work"}}} May 19 06:30:36.588756 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: May 19 06:30:36.588756 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 19 06:30:36.590518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1589054434', 'metadata': {'Type': 'work'}}}} May 19 06:30:36.590518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:30:36.590518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:30:36.590518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 06:30:36.590518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 06:30:36.590518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 06:30:36.590518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise error May 19 06:30:36.590518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 19 06:30:36.590518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:30:36.590518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 19 06:30:36.590518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 19 06:30:36.590518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:30:36.590518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi On instance['volume']: May 19 06:30:36.590518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi '0' May 19 06:30:36.590518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:30:36.590518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:30:36.590518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:30:36.590518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:30:36.590518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:30:36.590518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:30:36.590518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:30:36.590518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:30:36.593204 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 06:30:36.593204 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 06:30:36.593204 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:30:36.593204 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:30:36.593204 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 06:30:36.593204 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 06:30:36.593204 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 06:30:36.593204 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 06:30:36.593204 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 06:30:36.593204 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 06:30:36.593204 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 19 06:30:36.593204 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:30:36.593204 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:30:36.593204 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:30:36.593204 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:30:36.593204 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:30:36.593204 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:30:36.593204 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 06:30:36.593204 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 06:30:36.598924 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 19 06:30:36.598924 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:30:36.598924 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5487d396-04ba-4cf0-a3a7-b6ba2edd0bf1 tempest-VolumesNegativeTest-1249090744 tempest-VolumesNegativeTest-1249090744-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:30:36.598924 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5487d396-04ba-4cf0-a3a7-b6ba2edd0bf1 tempest-VolumesNegativeTest-1249090744 tempest-VolumesNegativeTest-1249090744-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.023333 May 19 06:30:36.603826 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 2/2] 10.222.0.65 () {60 vars in 1155 bytes} [Thu May 19 06:30:36 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 06:30:36.609227 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0629ddd5-9ad8-477e-b7e6-fd3eb9455771 tempest-VolumesNegativeTest-1249090744 tempest-VolumesNegativeTest-1249090744-project] Action: 'create', calling method: .version_select at 0x7f9af1573700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1158199401", "metadata": {"Type": "work"}}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:30:36.612268 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0629ddd5-9ad8-477e-b7e6-fd3eb9455771 tempest-VolumesNegativeTest-1249090744 tempest-VolumesNegativeTest-1249090744-project] Request method failure captured: May 19 06:30:36.612268 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 19 06:30:36.612268 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:30:36.612268 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:30:36.612268 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:30:36.612268 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 119 May 19 06:30:36.612268 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:30:36.612268 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:30:36.612268 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:30:36.612268 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:30:36.612268 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheQK_r5FSbR8QAnWRvfPIs2bxqwd1GsxqMxo7ji7EV_F7zEkWDRfqAOgjSVJH-2Cmby-NiIYdbC-_dTFi__YE6MQOlpuqdfEoBbd-iZ66P-ZeJYQKF6cHnHIG743Cd_jeXGFWssfAOVlYSLyziU0Ml8RirH9Lx__QENiwzhbzqbqr5Q May 19 06:30:36.612268 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:30:36.612268 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:30:36.612268 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:30:36.612268 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:30:36.612268 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:30:36.612268 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:30:36.612268 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: d68c640e4ce049e1b051070692d205f7 May 19 06:30:36.612268 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-VolumesNegativeTest-1249090744 May 19 06:30:36.612268 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:30:36.612268 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:30:36.615129 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d68c640e4ce049e1b051070692d205f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d68c640e4ce049e1b051070692d205f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d68c640e4ce049e1b051070692d205f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d68c640e4ce049e1b051070692d205f7", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:30:36.615129 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-VolumesNegativeTest-1249090744 May 19 06:30:36.615129 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: d68c640e4ce049e1b051070692d205f7 May 19 06:30:36.615129 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-VolumesNegativeTest-1249090744 May 19 06:30:36.615129 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-VolumesNegativeTest-1249090744-project May 19 06:30:36.615129 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:30:36.615129 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:30:36.615129 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: 8a6e7c96b7c54bf89e7cc7f819bcc135 May 19 06:30:36.615129 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-VolumesNegativeTest-1249090744-project May 19 06:30:36.615129 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: May 19 06:30:36.615129 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1158199401", "metadata": {"Type": "work"}}} May 19 06:30:36.615129 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: May 19 06:30:36.615129 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 19 06:30:36.616929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1158199401', 'metadata': {'Type': 'work'}}}} May 19 06:30:36.616929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:30:36.616929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:30:36.616929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 06:30:36.616929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 06:30:36.616929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 06:30:36.616929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise error May 19 06:30:36.616929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 19 06:30:36.616929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:30:36.616929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 19 06:30:36.616929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 19 06:30:36.616929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:30:36.616929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi On instance['volume']: May 19 06:30:36.616929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi '' May 19 06:30:36.616929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:30:36.616929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:30:36.616929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:30:36.616929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:30:36.616929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:30:36.616929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:30:36.616929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:30:36.616929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:30:36.621534 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 06:30:36.621534 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 06:30:36.621534 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:30:36.621534 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:30:36.621534 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 06:30:36.621534 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 06:30:36.621534 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 06:30:36.621534 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 06:30:36.621534 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 06:30:36.621534 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 06:30:36.621534 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 19 06:30:36.621534 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:30:36.621534 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:30:36.621534 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:30:36.621534 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:30:36.621534 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:30:36.621534 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:30:36.621534 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 06:30:36.621534 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 06:30:36.625201 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 19 06:30:36.625201 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:30:36.625201 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0629ddd5-9ad8-477e-b7e6-fd3eb9455771 tempest-VolumesNegativeTest-1249090744 tempest-VolumesNegativeTest-1249090744-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:30:36.625201 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0629ddd5-9ad8-477e-b7e6-fd3eb9455771 tempest-VolumesNegativeTest-1249090744 tempest-VolumesNegativeTest-1249090744-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011211 May 19 06:30:36.628046 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 3/3] 10.222.0.65 () {60 vars in 1155 bytes} [Thu May 19 06:30:36 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 06:30:36.646952 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-743575c6-d697-411e-8ba1-0128dee5412a tempest-VolumesNegativeTest-1249090744 tempest-VolumesNegativeTest-1249090744-project] Calling method '.version_select at 0x7f9af14a3430>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:30:37.590668 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-743575c6-d697-411e-8ba1-0128dee5412a tempest-VolumesNegativeTest-1249090744 tempest-VolumesNegativeTest-1249090744-project] HTTP exception thrown: Volume tempest-invalid-2141517336 could not be found. May 19 06:30:37.595473 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-743575c6-d697-411e-8ba1-0128dee5412a tempest-VolumesNegativeTest-1249090744 tempest-VolumesNegativeTest-1249090744-project] Request method failure captured: May 19 06:30:37.595473 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2141517336 HTTP/1.1 May 19 06:30:37.595473 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:30:37.595473 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:30:37.595473 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:30:37.595473 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 0 May 19 06:30:37.595473 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:30:37.595473 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:30:37.595473 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:30:37.595473 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:30:37.595473 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheQK_r5FSbR8QAnWRvfPIs2bxqwd1GsxqMxo7ji7EV_F7zEkWDRfqAOgjSVJH-2Cmby-NiIYdbC-_dTFi__YE6MQOlpuqdfEoBbd-iZ66P-ZeJYQKF6cHnHIG743Cd_jeXGFWssfAOVlYSLyziU0Ml8RirH9Lx__QENiwzhbzqbqr5Q May 19 06:30:37.595473 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:30:37.595473 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:30:37.595473 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:30:37.595473 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:30:37.595473 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:30:37.595473 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:30:37.595473 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: d68c640e4ce049e1b051070692d205f7 May 19 06:30:37.595473 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-VolumesNegativeTest-1249090744 May 19 06:30:37.595473 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:30:37.595473 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:30:37.598128 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d68c640e4ce049e1b051070692d205f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d68c640e4ce049e1b051070692d205f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d68c640e4ce049e1b051070692d205f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d68c640e4ce049e1b051070692d205f7", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:30:37.598128 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-VolumesNegativeTest-1249090744 May 19 06:30:37.598128 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: d68c640e4ce049e1b051070692d205f7 May 19 06:30:37.598128 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-VolumesNegativeTest-1249090744 May 19 06:30:37.598128 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-VolumesNegativeTest-1249090744-project May 19 06:30:37.598128 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:30:37.598128 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:30:37.598128 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: 8a6e7c96b7c54bf89e7cc7f819bcc135 May 19 06:30:37.598128 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-VolumesNegativeTest-1249090744-project May 19 06:30:37.598128 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: May 19 06:30:37.598128 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Volume tempest-invalid-2141517336 could not be found. May 19 06:30:37.598128 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'id': 'tempest-invalid-2141517336'} May 19 06:30:37.598128 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:30:37.599604 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:30:37.599604 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 06:30:37.599604 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 06:30:37.599604 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 06:30:37.599604 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 06:30:37.599604 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 06:30:37.599604 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 06:30:37.599604 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 06:30:37.599604 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 06:30:37.599604 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 06:30:37.599604 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 06:30:37.599604 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 06:30:37.599604 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 06:30:37.599604 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 06:30:37.599604 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 06:30:37.599604 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2141517336 could not be found. (HTTP 404) (Request-ID: req-5c3b1d30-88c8-4a57-b30c-1904e0bdda19) May 19 06:30:37.599604 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:30:37.599604 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:30:37.599604 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:30:37.604366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:30:37.604366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 19 06:30:37.604366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 19 06:30:37.604366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 06:30:37.604366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 06:30:37.604366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 06:30:37.604366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 06:30:37.604366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 06:30:37.604366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 06:30:37.604366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 06:30:37.604366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 06:30:37.604366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 06:30:37.604366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 06:30:37.604366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 06:30:37.604366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 06:30:37.604366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 06:30:37.604366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 06:30:37.604366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 06:30:37.604366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 06:30:37.610155 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 06:30:37.610155 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 06:30:37.610155 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 06:30:37.610155 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 06:30:37.610155 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2141517336 could not be found. May 19 06:30:37.610155 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:30:37.610155 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:30:37.610155 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:30:37.610155 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:30:37.610155 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:30:37.610155 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:30:37.610155 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:30:37.610155 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:30:37.610155 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 06:30:37.610155 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 06:30:37.610155 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:30:37.610155 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:30:37.610155 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 19 06:30:37.610155 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:30:37.610155 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2141517336 could not be found. May 19 06:30:37.614889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:30:37.614889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:30:37.614889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:30:37.614889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:30:37.614889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:30:37.614889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:30:37.614889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:30:37.614889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:30:37.614889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2141517336 could not be found. May 19 06:30:37.614889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:30:37.614889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-743575c6-d697-411e-8ba1-0128dee5412a tempest-VolumesNegativeTest-1249090744 tempest-VolumesNegativeTest-1249090744-project] Returning 404 to user: Volume tempest-invalid-2141517336 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:30:37.614889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-743575c6-d697-411e-8ba1-0128dee5412a tempest-VolumesNegativeTest-1249090744 tempest-VolumesNegativeTest-1249090744-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2141517336" status: 404 len: 99 microversion: 2.1 time: 0.970333 May 19 06:30:37.614889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 4/4] 10.222.0.65 () {58 vars in 1217 bytes} [Thu May 19 06:30:36 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2141517336 => generated 99 bytes in 983 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 06:30:37.752624 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0db9bf8f-6fe9-4bab-8642-6efe1d154984 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1100562618", "imageRef": "27959167-098e-44c5-ba0a-e9fb8054c377", "flavorRef": "452", "networks": [{"uuid": "70c072c3-7dc7-4861-964c-3f309033f32a"}]}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:30:37.832649 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-46937487-9eb1-414c-b838-479c9600c78f tempest-VolumesGetTestJSON-1135948218 tempest-VolumesGetTestJSON-1135948218-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.351391 May 19 06:30:37.833989 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 1/5] 10.222.0.65 () {60 vars in 1155 bytes} [Thu May 19 06:30:33 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4363 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 19 06:30:37.847836 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3039e75a-6b05-4f59-92d9-259ee402ff12 tempest-VolumesNegativeTest-1249090744 tempest-VolumesNegativeTest-1249090744-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012173 May 19 06:30:37.850061 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 2/6] 10.222.0.65 () {58 vars in 1139 bytes} [Thu May 19 06:30:37 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 19 06:30:37.870292 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-65793e0b-7c5a-489e-8caf-0c3e8d0f7ec0 tempest-VolumesGetTestJSON-1135948218 tempest-VolumesGetTestJSON-1135948218-project] Calling method '.version_select at 0x7f9af1487790>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:30:38.037029 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-65793e0b-7c5a-489e-8caf-0c3e8d0f7ec0 tempest-VolumesGetTestJSON-1135948218 tempest-VolumesGetTestJSON-1135948218-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/d8ab8358-c660-481d-adfd-5cad9dcca947" status: 200 len: 353 microversion: 2.1 time: 0.178296 May 19 06:30:38.044841 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 3/7] 10.222.0.65 () {58 vars in 1244 bytes} [Thu May 19 06:30:37 2022] GET /compute/v2.1/os-volumes/d8ab8358-c660-481d-adfd-5cad9dcca947 => generated 353 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:30:38.052185 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4009c07e-240c-4220-93f0-3bc305f38e89 tempest-VolumesNegativeTest-1249090744 tempest-VolumesNegativeTest-1249090744-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005977 May 19 06:30:38.054474 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 4/8] 10.222.0.65 () {58 vars in 1136 bytes} [Thu May 19 06:30:38 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 19 06:30:38.076480 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-46b87e64-3ea0-44d5-b82f-578a9b42e4b4 tempest-VolumesNegativeTest-1249090744 tempest-VolumesNegativeTest-1249090744-project] Calling method '.version_select at 0x7f9af1487670>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:30:38.142233 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.network.neutron [None req-0db9bf8f-6fe9-4bab-8642-6efe1d154984 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] validate_networks() for [('70c072c3-7dc7-4861-964c-3f309033f32a', None, None, None, None, None)] {{(pid=117711) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 06:30:38.188772 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-46b87e64-3ea0-44d5-b82f-578a9b42e4b4 tempest-VolumesNegativeTest-1249090744 tempest-VolumesNegativeTest-1249090744-project] HTTP exception thrown: Volume dd7012f0-7c7c-4394-a4e7-50623db92296 could not be found. May 19 06:30:38.199693 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-46b87e64-3ea0-44d5-b82f-578a9b42e4b4 tempest-VolumesNegativeTest-1249090744 tempest-VolumesNegativeTest-1249090744-project] Request method failure captured: May 19 06:30:38.199693 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: request: DELETE /compute/v2.1/os-volumes/dd7012f0-7c7c-4394-a4e7-50623db92296 HTTP/1.1 May 19 06:30:38.199693 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept: application/json May 19 06:30:38.199693 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity May 19 06:30:38.199693 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Connection: close May 19 06:30:38.199693 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Length: 0 May 19 06:30:38.199693 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Type: application/json May 19 06:30:38.199693 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Host: 10.222.0.65 May 19 06:30:38.199693 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None May 19 06:30:38.199693 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 May 19 06:30:38.199693 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiheQK_r5FSbR8QAnWRvfPIs2bxqwd1GsxqMxo7ji7EV_F7zEkWDRfqAOgjSVJH-2Cmby-NiIYdbC-_dTFi__YE6MQOlpuqdfEoBbd-iZ66P-ZeJYQKF6cHnHIG743Cd_jeXGFWssfAOVlYSLyziU0Ml8RirH9Lx__QENiwzhbzqbqr5Q May 19 06:30:38.199693 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Id: None May 19 06:30:38.199693 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Name: None May 19 06:30:38.199693 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed May 19 06:30:38.199693 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True May 19 06:30:38.199693 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default May 19 06:30:38.199693 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default May 19 06:30:38.199693 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Id: d68c640e4ce049e1b051070692d205f7 May 19 06:30:38.199693 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-VolumesNegativeTest-1249090744 May 19 06:30:38.199693 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Role: reader,member May 19 06:30:38.199693 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Roles: reader,member May 19 06:30:38.201146 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d68c640e4ce049e1b051070692d205f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d68c640e4ce049e1b051070692d205f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d68c640e4ce049e1b051070692d205f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d68c640e4ce049e1b051070692d205f7", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:30:38.201146 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-VolumesNegativeTest-1249090744 May 19 06:30:38.201146 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Id: d68c640e4ce049e1b051070692d205f7 May 19 06:30:38.201146 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-VolumesNegativeTest-1249090744 May 19 06:30:38.201146 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User: tempest-VolumesNegativeTest-1249090744-project May 19 06:30:38.201146 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default May 19 06:30:38.201146 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default May 19 06:30:38.201146 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Id: 8a6e7c96b7c54bf89e7cc7f819bcc135 May 19 06:30:38.201146 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-VolumesNegativeTest-1249090744-project May 19 06:30:38.201146 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: method: May 19 06:30:38.201146 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: exception: Volume dd7012f0-7c7c-4394-a4e7-50623db92296 could not be found. May 19 06:30:38.201146 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: action_args: {'id': 'dd7012f0-7c7c-4394-a4e7-50623db92296'} May 19 06:30:38.201146 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:30:38.202104 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:30:38.202104 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 06:30:38.202104 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 06:30:38.202104 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 06:30:38.202104 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 06:30:38.202104 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 06:30:38.202104 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 06:30:38.202104 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 06:30:38.202104 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 06:30:38.202104 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 06:30:38.202104 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 06:30:38.202104 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 06:30:38.202104 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 06:30:38.202104 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 06:30:38.202104 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 06:30:38.202104 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dd7012f0-7c7c-4394-a4e7-50623db92296 could not be found. (HTTP 404) (Request-ID: req-098465f0-b653-4198-8a15-89e00dc78d4f) May 19 06:30:38.202104 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:30:38.202104 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:30:38.202104 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:30:38.203432 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:30:38.203432 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 19 06:30:38.203432 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 19 06:30:38.203432 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 06:30:38.203432 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 06:30:38.203432 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 06:30:38.203432 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 06:30:38.203432 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 06:30:38.203432 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 06:30:38.203432 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 06:30:38.203432 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 06:30:38.203432 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 06:30:38.203432 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 06:30:38.203432 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 06:30:38.203432 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 06:30:38.203432 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 06:30:38.203432 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 06:30:38.203432 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 06:30:38.203432 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 06:30:38.204727 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 06:30:38.204727 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 06:30:38.204727 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 06:30:38.204727 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 06:30:38.204727 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dd7012f0-7c7c-4394-a4e7-50623db92296 could not be found. May 19 06:30:38.204727 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:30:38.204727 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:30:38.204727 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:30:38.204727 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:30:38.204727 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:30:38.204727 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:30:38.204727 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:30:38.204727 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:30:38.204727 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 06:30:38.204727 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 06:30:38.204727 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:30:38.204727 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:30:38.204727 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 19 06:30:38.204727 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:30:38.206208 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dd7012f0-7c7c-4394-a4e7-50623db92296 could not be found. May 19 06:30:38.206208 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:30:38.206208 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:30:38.206208 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:30:38.206208 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:30:38.206208 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:30:38.206208 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:30:38.206208 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:30:38.206208 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:30:38.206208 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dd7012f0-7c7c-4394-a4e7-50623db92296 could not be found. May 19 06:30:38.206208 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:30:38.206208 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-46b87e64-3ea0-44d5-b82f-578a9b42e4b4 tempest-VolumesNegativeTest-1249090744 tempest-VolumesNegativeTest-1249090744-project] Returning 404 to user: Volume dd7012f0-7c7c-4394-a4e7-50623db92296 could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:30:38.206208 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-46b87e64-3ea0-44d5-b82f-578a9b42e4b4 tempest-VolumesNegativeTest-1249090744 tempest-VolumesNegativeTest-1249090744-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/dd7012f0-7c7c-4394-a4e7-50623db92296" status: 404 len: 109 microversion: 2.1 time: 0.140214 May 19 06:30:38.215123 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 5/9] 10.222.0.65 () {58 vars in 1247 bytes} [Thu May 19 06:30:38 2022] DELETE /compute/v2.1/os-volumes/dd7012f0-7c7c-4394-a4e7-50623db92296 => generated 109 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 06:30:38.245142 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-99e49ace-175d-4dfc-9322-9f9b8bab315a tempest-VolumesNegativeTest-1249090744 tempest-VolumesNegativeTest-1249090744-project] Calling method '.version_select at 0x7f9af1dec9d0>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:30:38.370661 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-99e49ace-175d-4dfc-9322-9f9b8bab315a tempest-VolumesNegativeTest-1249090744 tempest-VolumesNegativeTest-1249090744-project] HTTP exception thrown: Volume ac73a339-9ad1-49f3-b2ac-35085b2ef52c could not be found. May 19 06:30:38.370661 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-99e49ace-175d-4dfc-9322-9f9b8bab315a tempest-VolumesNegativeTest-1249090744 tempest-VolumesNegativeTest-1249090744-project] Request method failure captured: May 19 06:30:38.370661 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/os-volumes/ac73a339-9ad1-49f3-b2ac-35085b2ef52c HTTP/1.1 May 19 06:30:38.370661 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept: application/json May 19 06:30:38.370661 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity May 19 06:30:38.370661 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Connection: close May 19 06:30:38.370661 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Length: 0 May 19 06:30:38.370661 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Type: application/json May 19 06:30:38.370661 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Host: 10.222.0.65 May 19 06:30:38.370661 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None May 19 06:30:38.370661 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 May 19 06:30:38.370661 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiheQK_r5FSbR8QAnWRvfPIs2bxqwd1GsxqMxo7ji7EV_F7zEkWDRfqAOgjSVJH-2Cmby-NiIYdbC-_dTFi__YE6MQOlpuqdfEoBbd-iZ66P-ZeJYQKF6cHnHIG743Cd_jeXGFWssfAOVlYSLyziU0Ml8RirH9Lx__QENiwzhbzqbqr5Q May 19 06:30:38.370661 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Id: None May 19 06:30:38.370661 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Name: None May 19 06:30:38.370661 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed May 19 06:30:38.370661 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True May 19 06:30:38.370661 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default May 19 06:30:38.370661 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default May 19 06:30:38.370661 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Id: d68c640e4ce049e1b051070692d205f7 May 19 06:30:38.370661 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-VolumesNegativeTest-1249090744 May 19 06:30:38.370661 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Role: reader,member May 19 06:30:38.370661 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Roles: reader,member May 19 06:30:38.379558 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d68c640e4ce049e1b051070692d205f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d68c640e4ce049e1b051070692d205f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d68c640e4ce049e1b051070692d205f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d68c640e4ce049e1b051070692d205f7", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:30:38.379558 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-VolumesNegativeTest-1249090744 May 19 06:30:38.379558 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Id: d68c640e4ce049e1b051070692d205f7 May 19 06:30:38.379558 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-VolumesNegativeTest-1249090744 May 19 06:30:38.379558 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User: tempest-VolumesNegativeTest-1249090744-project May 19 06:30:38.379558 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default May 19 06:30:38.379558 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default May 19 06:30:38.379558 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Id: 8a6e7c96b7c54bf89e7cc7f819bcc135 May 19 06:30:38.379558 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-VolumesNegativeTest-1249090744-project May 19 06:30:38.379558 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: method: May 19 06:30:38.379558 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: exception: Volume ac73a339-9ad1-49f3-b2ac-35085b2ef52c could not be found. May 19 06:30:38.379558 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: action_args: {'id': 'ac73a339-9ad1-49f3-b2ac-35085b2ef52c'} May 19 06:30:38.379558 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:30:38.387520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:30:38.387520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 06:30:38.387520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 06:30:38.387520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 06:30:38.387520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 06:30:38.387520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 06:30:38.387520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 06:30:38.387520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 06:30:38.387520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 06:30:38.387520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 06:30:38.387520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 06:30:38.387520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 06:30:38.387520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 06:30:38.387520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 06:30:38.387520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 06:30:38.387520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ac73a339-9ad1-49f3-b2ac-35085b2ef52c could not be found. (HTTP 404) (Request-ID: req-fde4ef73-d640-4f50-913d-187347d096c6) May 19 06:30:38.387520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:30:38.387520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:30:38.387520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:30:38.393022 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:30:38.393022 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 06:30:38.393022 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 06:30:38.393022 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 06:30:38.393022 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 06:30:38.393022 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 06:30:38.393022 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 06:30:38.393022 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 06:30:38.393022 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 06:30:38.393022 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 06:30:38.393022 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 06:30:38.393022 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 06:30:38.393022 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 06:30:38.393022 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 06:30:38.393022 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 06:30:38.393022 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 06:30:38.393022 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 06:30:38.393022 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 06:30:38.393022 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 06:30:38.395480 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 06:30:38.395480 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 06:30:38.395480 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 06:30:38.395480 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 06:30:38.395480 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ac73a339-9ad1-49f3-b2ac-35085b2ef52c could not be found. May 19 06:30:38.395480 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:30:38.395480 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:30:38.395480 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:30:38.395480 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:30:38.395480 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:30:38.395480 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:30:38.395480 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:30:38.395480 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:30:38.395480 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 06:30:38.395480 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 06:30:38.395480 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:30:38.395480 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:30:38.395480 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 06:30:38.395480 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:30:38.401204 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ac73a339-9ad1-49f3-b2ac-35085b2ef52c could not be found. May 19 06:30:38.401204 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:30:38.401204 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:30:38.401204 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:30:38.401204 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:30:38.401204 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:30:38.401204 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:30:38.401204 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:30:38.401204 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:30:38.401204 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ac73a339-9ad1-49f3-b2ac-35085b2ef52c could not be found. May 19 06:30:38.401204 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:30:38.401204 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-99e49ace-175d-4dfc-9322-9f9b8bab315a tempest-VolumesNegativeTest-1249090744 tempest-VolumesNegativeTest-1249090744-project] Returning 404 to user: Volume ac73a339-9ad1-49f3-b2ac-35085b2ef52c could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:30:38.401204 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-99e49ace-175d-4dfc-9322-9f9b8bab315a tempest-VolumesNegativeTest-1249090744 tempest-VolumesNegativeTest-1249090744-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/ac73a339-9ad1-49f3-b2ac-35085b2ef52c" status: 404 len: 109 microversion: 2.1 time: 0.143954 May 19 06:30:38.401204 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 6/10] 10.222.0.65 () {58 vars in 1244 bytes} [Thu May 19 06:30:38 2022] GET /compute/v2.1/os-volumes/ac73a339-9ad1-49f3-b2ac-35085b2ef52c => generated 109 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:30:39.055964 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3befac99-b5dc-46a5-b057-37463956e121 tempest-VolumesGetTestJSON-1135948218 tempest-VolumesGetTestJSON-1135948218-project] Calling method '.version_select at 0x7f9af14044c0>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:30:39.182031 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3befac99-b5dc-46a5-b057-37463956e121 tempest-VolumesGetTestJSON-1135948218 tempest-VolumesGetTestJSON-1135948218-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/d8ab8358-c660-481d-adfd-5cad9dcca947" status: 200 len: 354 microversion: 2.1 time: 0.133631 May 19 06:30:39.189634 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 7/11] 10.222.0.65 () {58 vars in 1244 bytes} [Thu May 19 06:30:39 2022] GET /compute/v2.1/os-volumes/d8ab8358-c660-481d-adfd-5cad9dcca947 => generated 354 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:30:39.200089 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e175b88a-625f-452b-926f-02cc27a0bdda tempest-VolumesGetTestJSON-1135948218 tempest-VolumesGetTestJSON-1135948218-project] Calling method '.version_select at 0x7f9af1404b80>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:30:39.399897 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e175b88a-625f-452b-926f-02cc27a0bdda tempest-VolumesGetTestJSON-1135948218 tempest-VolumesGetTestJSON-1135948218-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/d8ab8358-c660-481d-adfd-5cad9dcca947" status: 200 len: 354 microversion: 2.1 time: 0.207821 May 19 06:30:39.424766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 8/12] 10.222.0.65 () {58 vars in 1244 bytes} [Thu May 19 06:30:39 2022] GET /compute/v2.1/os-volumes/d8ab8358-c660-481d-adfd-5cad9dcca947 => generated 354 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:30:39.440043 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f7c88608-2757-47c2-8567-6d8137f715c7 tempest-VolumesGetTestJSON-1135948218 tempest-VolumesGetTestJSON-1135948218-project] Calling method '.version_select at 0x7f9af1487e50>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:30:39.622455 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f7c88608-2757-47c2-8567-6d8137f715c7 tempest-VolumesGetTestJSON-1135948218 tempest-VolumesGetTestJSON-1135948218-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/d8ab8358-c660-481d-adfd-5cad9dcca947" status: 202 len: 0 microversion: 2.1 time: 0.194519 May 19 06:30:39.640338 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 9/13] 10.222.0.65 () {58 vars in 1247 bytes} [Thu May 19 06:30:39 2022] DELETE /compute/v2.1/os-volumes/d8ab8358-c660-481d-adfd-5cad9dcca947 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 06:30:39.649011 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-91b7950c-5bf4-48b7-a92e-a2e9477d597c tempest-VolumesGetTestJSON-1135948218 tempest-VolumesGetTestJSON-1135948218-project] Calling method '.version_select at 0x7f9af1dec790>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:30:39.779343 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-91b7950c-5bf4-48b7-a92e-a2e9477d597c tempest-VolumesGetTestJSON-1135948218 tempest-VolumesGetTestJSON-1135948218-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/d8ab8358-c660-481d-adfd-5cad9dcca947" status: 200 len: 353 microversion: 2.1 time: 0.137038 May 19 06:30:39.786171 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 10/14] 10.222.0.65 () {58 vars in 1244 bytes} [Thu May 19 06:30:39 2022] GET /compute/v2.1/os-volumes/d8ab8358-c660-481d-adfd-5cad9dcca947 => generated 353 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:30:40.660578 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-0db9bf8f-6fe9-4bab-8642-6efe1d154984 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Flavor limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 06:30:40.661550 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-0db9bf8f-6fe9-4bab-8642-6efe1d154984 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Image limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 06:30:40.661550 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-0db9bf8f-6fe9-4bab-8642-6efe1d154984 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Flavor pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 06:30:40.662007 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-0db9bf8f-6fe9-4bab-8642-6efe1d154984 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Image pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 06:30:40.662419 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-0db9bf8f-6fe9-4bab-8642-6efe1d154984 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 06:30:40.695086 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0db9bf8f-6fe9-4bab-8642-6efe1d154984 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:30:40.696756 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0db9bf8f-6fe9-4bab-8642-6efe1d154984 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:30:40.698019 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0db9bf8f-6fe9-4bab-8642-6efe1d154984 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:30:40.698970 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0db9bf8f-6fe9-4bab-8642-6efe1d154984 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:30:40.797345 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-76e68e0c-840f-4c11-8018-c8175d099d40 tempest-VolumesGetTestJSON-1135948218 tempest-VolumesGetTestJSON-1135948218-project] Calling method '.version_select at 0x7f9af1404940>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:30:40.831098 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-0db9bf8f-6fe9-4bab-8642-6efe1d154984 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Getting quotas for project d2d7305d881a4ee29213497d3bab5937. Resources: {'ram', 'cores', 'instances'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:30:40.859794 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-0db9bf8f-6fe9-4bab-8642-6efe1d154984 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Getting quotas for user 184b6909ea6649f3b5eadceef3cca359 and project d2d7305d881a4ee29213497d3bab5937. Resources: {'ram', 'cores', 'instances'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:30:40.879109 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-76e68e0c-840f-4c11-8018-c8175d099d40 tempest-VolumesGetTestJSON-1135948218 tempest-VolumesGetTestJSON-1135948218-project] HTTP exception thrown: Volume d8ab8358-c660-481d-adfd-5cad9dcca947 could not be found. May 19 06:30:40.887763 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0db9bf8f-6fe9-4bab-8642-6efe1d154984 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Going to run 1 instances... {{(pid=117711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 06:30:40.888787 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-76e68e0c-840f-4c11-8018-c8175d099d40 tempest-VolumesGetTestJSON-1135948218 tempest-VolumesGetTestJSON-1135948218-project] Request method failure captured: May 19 06:30:40.888787 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/os-volumes/d8ab8358-c660-481d-adfd-5cad9dcca947 HTTP/1.1 May 19 06:30:40.888787 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept: application/json May 19 06:30:40.888787 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity May 19 06:30:40.888787 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Connection: close May 19 06:30:40.888787 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Length: 0 May 19 06:30:40.888787 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Type: application/json May 19 06:30:40.888787 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Host: 10.222.0.65 May 19 06:30:40.888787 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None May 19 06:30:40.888787 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 May 19 06:30:40.888787 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiheQJQCXHvapvwGWMCDPp5VHCk_k8Fu9BJ7tcZ1sdch1bd527s_JnuQZuJOidmtzeK0qn-o9wHYlP8myzjn42PfQXwm6Z81D01AVV6ENuruS21ucy89qOXciAwS_3mqOSttYD7l2OgULdiR8m9VF3dfh39aoI-kWDYEgzN7js0O4AYnM May 19 06:30:40.888787 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Id: None May 19 06:30:40.888787 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Name: None May 19 06:30:40.888787 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed May 19 06:30:40.888787 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True May 19 06:30:40.888787 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default May 19 06:30:40.888787 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default May 19 06:30:40.888787 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Id: 95990ba77ff749e0aa91bed9d1608e43 May 19 06:30:40.888787 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-VolumesGetTestJSON-1135948218 May 19 06:30:40.888787 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Role: reader,member May 19 06:30:40.888787 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Roles: reader,member May 19 06:30:40.891323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/95990ba77ff749e0aa91bed9d1608e43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/95990ba77ff749e0aa91bed9d1608e43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/95990ba77ff749e0aa91bed9d1608e43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_95990ba77ff749e0aa91bed9d1608e43", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:30:40.891323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-VolumesGetTestJSON-1135948218 May 19 06:30:40.891323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Id: 95990ba77ff749e0aa91bed9d1608e43 May 19 06:30:40.891323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-VolumesGetTestJSON-1135948218 May 19 06:30:40.891323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User: tempest-VolumesGetTestJSON-1135948218-project May 19 06:30:40.891323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default May 19 06:30:40.891323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default May 19 06:30:40.891323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Id: e6bc1ead7d8947ada932b4544fe6b180 May 19 06:30:40.891323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-VolumesGetTestJSON-1135948218-project May 19 06:30:40.891323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: method: May 19 06:30:40.891323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: exception: Volume d8ab8358-c660-481d-adfd-5cad9dcca947 could not be found. May 19 06:30:40.891323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: action_args: {'id': 'd8ab8358-c660-481d-adfd-5cad9dcca947'} May 19 06:30:40.891323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:30:40.893241 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:30:40.893241 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 06:30:40.893241 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 06:30:40.893241 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 06:30:40.893241 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 06:30:40.893241 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 06:30:40.893241 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 06:30:40.893241 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 06:30:40.893241 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 06:30:40.893241 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 06:30:40.893241 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 06:30:40.893241 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 06:30:40.893241 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 06:30:40.893241 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 06:30:40.893241 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 06:30:40.893241 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d8ab8358-c660-481d-adfd-5cad9dcca947 could not be found. (HTTP 404) (Request-ID: req-891d833a-76b6-4f64-a8de-0e8eefe87fab) May 19 06:30:40.893241 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:30:40.893241 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:30:40.893241 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:30:40.895794 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:30:40.895794 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 06:30:40.895794 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 06:30:40.895794 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 06:30:40.895794 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 06:30:40.895794 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 06:30:40.895794 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 06:30:40.895794 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 06:30:40.895794 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 06:30:40.895794 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 06:30:40.895794 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 06:30:40.895794 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 06:30:40.895794 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 06:30:40.895794 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 06:30:40.895794 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 06:30:40.895794 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 06:30:40.895794 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 06:30:40.895794 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 06:30:40.895794 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 06:30:40.898005 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 06:30:40.898005 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 06:30:40.898005 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 06:30:40.898005 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 06:30:40.898005 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d8ab8358-c660-481d-adfd-5cad9dcca947 could not be found. May 19 06:30:40.898005 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:30:40.898005 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:30:40.898005 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:30:40.898005 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:30:40.898005 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:30:40.898005 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:30:40.898005 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:30:40.898005 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:30:40.898005 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 06:30:40.898005 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 06:30:40.898005 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:30:40.898005 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:30:40.898005 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 06:30:40.898005 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:30:40.905526 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d8ab8358-c660-481d-adfd-5cad9dcca947 could not be found. May 19 06:30:40.905526 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:30:40.905526 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:30:40.905526 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:30:40.905526 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:30:40.905526 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:30:40.905526 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:30:40.905526 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:30:40.905526 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:30:40.905526 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d8ab8358-c660-481d-adfd-5cad9dcca947 could not be found. May 19 06:30:40.905526 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:30:40.907532 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0db9bf8f-6fe9-4bab-8642-6efe1d154984 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27959167-098e-44c5-ba0a-e9fb8054c377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 06:30:40.907711 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-76e68e0c-840f-4c11-8018-c8175d099d40 tempest-VolumesGetTestJSON-1135948218 tempest-VolumesGetTestJSON-1135948218-project] Returning 404 to user: Volume d8ab8358-c660-481d-adfd-5cad9dcca947 could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:30:40.907975 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-76e68e0c-840f-4c11-8018-c8175d099d40 tempest-VolumesGetTestJSON-1135948218 tempest-VolumesGetTestJSON-1135948218-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/d8ab8358-c660-481d-adfd-5cad9dcca947" status: 404 len: 109 microversion: 2.1 time: 0.119354 May 19 06:30:40.908901 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 11/15] 10.222.0.65 () {58 vars in 1244 bytes} [Thu May 19 06:30:40 2022] GET /compute/v2.1/os-volumes/d8ab8358-c660-481d-adfd-5cad9dcca947 => generated 109 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 06:30:41.085520 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0db9bf8f-6fe9-4bab-8642-6efe1d154984 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.474657 May 19 06:30:41.091095 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 5/16] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 06:30:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 06:30:41.105878 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-8c8d26f5-bb7c-41fc-8a81-793e79e6683b tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:30:41.107466 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-8c8d26f5-bb7c-41fc-8a81-793e79e6683b tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:30:41.474964 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8c8d26f5-bb7c-41fc-8a81-793e79e6683b tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '184b6909ea6649f3b5eadceef3cca359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d7305d881a4ee29213497d3bab5937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:30:41.546802 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-8c8d26f5-bb7c-41fc-8a81-793e79e6683b tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 200 len: 1215 microversion: 2.1 time: 0.445179 May 19 06:30:41.558148 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 12/17] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:30:41 2022] GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 1215 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:30:42.590816 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-9f7a119e-e7b5-4914-ac90-eac6325a7d40 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:30:42.592131 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-9f7a119e-e7b5-4914-ac90-eac6325a7d40 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:30:43.980377 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9f7a119e-e7b5-4914-ac90-eac6325a7d40 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '184b6909ea6649f3b5eadceef3cca359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d7305d881a4ee29213497d3bab5937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:30:44.073439 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-9f7a119e-e7b5-4914-ac90-eac6325a7d40 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 200 len: 1215 microversion: 2.1 time: 1.493864 May 19 06:30:44.074564 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 6/18] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:30:42 2022] GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 1215 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:30:45.112367 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-8152a7d3-b482-40fd-8bc4-16e2917e9b72 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:30:45.126481 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-8152a7d3-b482-40fd-8bc4-16e2917e9b72 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:30:45.412468 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8152a7d3-b482-40fd-8bc4-16e2917e9b72 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '184b6909ea6649f3b5eadceef3cca359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d7305d881a4ee29213497d3bab5937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:30:45.441664 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-8152a7d3-b482-40fd-8bc4-16e2917e9b72 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 200 len: 1215 microversion: 2.1 time: 0.343184 May 19 06:30:45.470045 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 13/19] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:30:45 2022] GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 1215 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:30:46.479365 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-196e026d-85c8-4498-b5f4-8cde74fffcb4 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:30:46.480375 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-196e026d-85c8-4498-b5f4-8cde74fffcb4 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:30:46.545384 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-196e026d-85c8-4498-b5f4-8cde74fffcb4 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:30:46.546144 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-196e026d-85c8-4498-b5f4-8cde74fffcb4 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:30:46.558114 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-196e026d-85c8-4498-b5f4-8cde74fffcb4 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:30:46.559123 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-196e026d-85c8-4498-b5f4-8cde74fffcb4 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:30:47.779409 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-196e026d-85c8-4498-b5f4-8cde74fffcb4 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '184b6909ea6649f3b5eadceef3cca359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d7305d881a4ee29213497d3bab5937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:30:47.888772 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-196e026d-85c8-4498-b5f4-8cde74fffcb4 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 200 len: 1267 microversion: 2.1 time: 1.411332 May 19 06:30:47.898123 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 7/20] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:30:46 2022] GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 1267 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:30:48.913459 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3d7db1b1-5a1b-4f64-8ede-f168ab224efb tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:30:48.915416 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3d7db1b1-5a1b-4f64-8ede-f168ab224efb tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:30:48.931578 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3d7db1b1-5a1b-4f64-8ede-f168ab224efb tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:30:48.932351 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3d7db1b1-5a1b-4f64-8ede-f168ab224efb tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:30:48.934833 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3d7db1b1-5a1b-4f64-8ede-f168ab224efb tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:30:48.935605 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3d7db1b1-5a1b-4f64-8ede-f168ab224efb tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:30:49.846031 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3d7db1b1-5a1b-4f64-8ede-f168ab224efb tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '184b6909ea6649f3b5eadceef3cca359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d7305d881a4ee29213497d3bab5937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:30:49.905723 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3d7db1b1-5a1b-4f64-8ede-f168ab224efb tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 200 len: 1273 microversion: 2.1 time: 0.996058 May 19 06:30:49.911243 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 14/21] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:30:48 2022] GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 1273 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:30:50.939034 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a4c573eb-ea9c-4d8f-80f4-941d243b6c39 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:30:50.942130 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a4c573eb-ea9c-4d8f-80f4-941d243b6c39 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:30:50.961157 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:30:50.978148 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a4c573eb-ea9c-4d8f-80f4-941d243b6c39 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:30:50.986945 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a4c573eb-ea9c-4d8f-80f4-941d243b6c39 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:30:50.992403 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a4c573eb-ea9c-4d8f-80f4-941d243b6c39 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:30:50.994250 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a4c573eb-ea9c-4d8f-80f4-941d243b6c39 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:30:51.855243 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a4c573eb-ea9c-4d8f-80f4-941d243b6c39 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '184b6909ea6649f3b5eadceef3cca359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d7305d881a4ee29213497d3bab5937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:30:51.942287 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a4c573eb-ea9c-4d8f-80f4-941d243b6c39 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 200 len: 1273 microversion: 2.1 time: 1.004956 May 19 06:30:51.948155 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 8/22] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:30:50 2022] GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 1273 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:30:52.971853 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b21b1a84-6d40-4255-ac59-bf013cef9fc0 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:30:52.974612 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b21b1a84-6d40-4255-ac59-bf013cef9fc0 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:30:53.016433 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b21b1a84-6d40-4255-ac59-bf013cef9fc0 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:30:53.030901 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b21b1a84-6d40-4255-ac59-bf013cef9fc0 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:30:53.039384 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b21b1a84-6d40-4255-ac59-bf013cef9fc0 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:30:53.044430 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b21b1a84-6d40-4255-ac59-bf013cef9fc0 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:30:53.516074 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b21b1a84-6d40-4255-ac59-bf013cef9fc0 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '184b6909ea6649f3b5eadceef3cca359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d7305d881a4ee29213497d3bab5937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:30:53.609156 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b21b1a84-6d40-4255-ac59-bf013cef9fc0 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 200 len: 1273 microversion: 2.1 time: 0.645092 May 19 06:30:53.616699 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 15/23] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:30:52 2022] GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 1273 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:30:54.639534 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7861b6af-cf40-4bee-a3e1-fedf497f33b0 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:30:54.640155 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7861b6af-cf40-4bee-a3e1-fedf497f33b0 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:30:54.659518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=8 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:30:54.677836 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7861b6af-cf40-4bee-a3e1-fedf497f33b0 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:30:54.682254 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7861b6af-cf40-4bee-a3e1-fedf497f33b0 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:30:54.683581 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7861b6af-cf40-4bee-a3e1-fedf497f33b0 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:30:54.690500 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7861b6af-cf40-4bee-a3e1-fedf497f33b0 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:30:55.287286 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7861b6af-cf40-4bee-a3e1-fedf497f33b0 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '184b6909ea6649f3b5eadceef3cca359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d7305d881a4ee29213497d3bab5937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:30:55.308370 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7861b6af-cf40-4bee-a3e1-fedf497f33b0 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 200 len: 1273 microversion: 2.1 time: 0.667972 May 19 06:30:55.312140 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 9/24] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:30:54 2022] GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 1273 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:30:56.344176 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3c99d453-84d5-484c-9753-57e8af9fec2f tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:30:56.352751 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3c99d453-84d5-484c-9753-57e8af9fec2f tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:30:56.413440 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=4 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:30:56.429632 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3c99d453-84d5-484c-9753-57e8af9fec2f tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:30:56.446777 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3c99d453-84d5-484c-9753-57e8af9fec2f tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:30:56.456056 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3c99d453-84d5-484c-9753-57e8af9fec2f tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:30:56.465340 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3c99d453-84d5-484c-9753-57e8af9fec2f tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:02.963954 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3c99d453-84d5-484c-9753-57e8af9fec2f tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '184b6909ea6649f3b5eadceef3cca359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d7305d881a4ee29213497d3bab5937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:03.053037 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3c99d453-84d5-484c-9753-57e8af9fec2f tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 200 len: 1315 microversion: 2.1 time: 6.703082 May 19 06:31:03.057527 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 16/25] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:30:56 2022] GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 1315 bytes in 6733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:04.087461 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5e4227f2-6dfe-43e9-a987-edbf021de89a tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:04.089630 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5e4227f2-6dfe-43e9-a987-edbf021de89a tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:04.217218 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5e4227f2-6dfe-43e9-a987-edbf021de89a tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:04.239585 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5e4227f2-6dfe-43e9-a987-edbf021de89a tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:04.260510 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5e4227f2-6dfe-43e9-a987-edbf021de89a tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:04.261740 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5e4227f2-6dfe-43e9-a987-edbf021de89a tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:05.814965 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5e4227f2-6dfe-43e9-a987-edbf021de89a tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '184b6909ea6649f3b5eadceef3cca359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d7305d881a4ee29213497d3bab5937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:05.822995 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=25 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:31:05.866756 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5e4227f2-6dfe-43e9-a987-edbf021de89a tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 200 len: 1315 microversion: 2.1 time: 1.785433 May 19 06:31:05.868265 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 10/26] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:04 2022] GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 1315 bytes in 1789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:06.423059 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=14 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:31:06.899602 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b7643edd-bb9d-4f0a-8432-faad9f5b5115 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:06.900427 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b7643edd-bb9d-4f0a-8432-faad9f5b5115 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:06.914272 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:31:06.944894 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b7643edd-bb9d-4f0a-8432-faad9f5b5115 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:06.947699 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b7643edd-bb9d-4f0a-8432-faad9f5b5115 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:06.948918 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b7643edd-bb9d-4f0a-8432-faad9f5b5115 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:06.967273 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b7643edd-bb9d-4f0a-8432-faad9f5b5115 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:07.221863 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d49ec27f-dcea-4401-8b86-86924d747ba9 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Action: 'create', calling method: .version_select at 0x7f9af12f5d30>, body: {"keypair": {"name": "tempest-keypair-1268562741", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeuRbUvh4rIrJ9Ij/SRmDp6ZqCVq8vt8wGnnMrN5Xue+dDr+mB7Qlcpqi6AGZPfB9FcZ2lU9o9L588ugYPVUMOVRnzAUJuxeySIOJe0BfJHX2RVvdF8yjHRpy61WRb6ug=="}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:31:07.384200 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-d49ec27f-dcea-4401-8b86-86924d747ba9 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Getting quotas for project adbcff8654844c22a906a2e91ebca3bb. Resources: {'key_pairs'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:31:07.408413 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-d49ec27f-dcea-4401-8b86-86924d747ba9 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Getting quotas for user cb2bf8531dfe42b29b0b632b39d49625 and project adbcff8654844c22a906a2e91ebca3bb. Resources: {'key_pairs'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:31:07.564416 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b7643edd-bb9d-4f0a-8432-faad9f5b5115 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '184b6909ea6649f3b5eadceef3cca359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d7305d881a4ee29213497d3bab5937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:07.580921 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b7643edd-bb9d-4f0a-8432-faad9f5b5115 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 200 len: 1315 microversion: 2.1 time: 0.697985 May 19 06:31:07.582007 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 11/27] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:06 2022] GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 1315 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:07.590475 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d49ec27f-dcea-4401-8b86-86924d747ba9 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.891542 May 19 06:31:07.592434 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 17/28] 10.222.0.65 () {60 vars in 1158 bytes} [Thu May 19 06:31:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1902 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:31:07.797238 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-0d147ee7-a4dc-4c53-a6ac-6464f3bbe646 req-3d8a4010-20ea-487e-a2e1-3359e3d67771 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bfcd957-5a5f-4c7b-81ea-61c732fc3354", "tag": "946cfd64-c054-41e4-aadd-9b6bf0f436f8"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:31:07.861158 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-0d147ee7-a4dc-4c53-a6ac-6464f3bbe646 req-3d8a4010-20ea-487e-a2e1-3359e3d67771 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:07.861947 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-0d147ee7-a4dc-4c53-a6ac-6464f3bbe646 req-3d8a4010-20ea-487e-a2e1-3359e3d67771 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:07.982494 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-0d147ee7-a4dc-4c53-a6ac-6464f3bbe646 req-3d8a4010-20ea-487e-a2e1-3359e3d67771 service nova] Creating event network-changed:946cfd64-c054-41e4-aadd-9b6bf0f436f8 for instance 7bfcd957-5a5f-4c7b-81ea-61c732fc3354 on hv-cinder-83699 May 19 06:31:07.983565 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-0d147ee7-a4dc-4c53-a6ac-6464f3bbe646 req-3d8a4010-20ea-487e-a2e1-3359e3d67771 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117711) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 06:31:07.984418 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3e44a99e-59d8-4eb8-81e6-c0708c7b3f7c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:07.984873 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3e44a99e-59d8-4eb8-81e6-c0708c7b3f7c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:07.985784 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3e44a99e-59d8-4eb8-81e6-c0708c7b3f7c None None] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:07.990646 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3e44a99e-59d8-4eb8-81e6-c0708c7b3f7c None None] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:08.042026 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.compute.rpcapi [None req-3e44a99e-59d8-4eb8-81e6-c0708c7b3f7c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 19 06:31:08.043751 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3e44a99e-59d8-4eb8-81e6-c0708c7b3f7c None None] Releasing lock "compute-rpcapi-router" {{(pid=117711) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 06:31:08.145612 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-3e44a99e-59d8-4eb8-81e6-c0708c7b3f7c None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.560751 May 19 06:31:08.146961 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 12/29] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:31:08.628432 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1d8cade9-0f10-4798-a4ce-69503501a52c tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:08.639736 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1d8cade9-0f10-4798-a4ce-69503501a52c tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:08.696940 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1d8cade9-0f10-4798-a4ce-69503501a52c tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:08.698044 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1d8cade9-0f10-4798-a4ce-69503501a52c tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:08.708313 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1d8cade9-0f10-4798-a4ce-69503501a52c tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:08.710907 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1d8cade9-0f10-4798-a4ce-69503501a52c tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:09.746223 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-fb26f1b4-4008-4e53-887b-629199751345 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Action: 'create', calling method: .version_select at 0x7f9af01b4700>, body: {"keypair": {"name": "tempest-keypair-1003694897", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwFdCqmfqCxwbsimmJjEdXx9zUQwfwR0G1cef9uBtObXn3SajeWGSRlwvqDlz4OuL0iGlUj4mR9NidAq2HNIJ6eff7c8X57LgU11hNI1edxOSA0JDHHipH0rGCRbzTOow=="}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:31:09.865221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-fb26f1b4-4008-4e53-887b-629199751345 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Getting quotas for project 1e8f1e4b9cd9432b90cb00a6be4d909e. Resources: {'key_pairs'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:31:09.886723 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-fb26f1b4-4008-4e53-887b-629199751345 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Getting quotas for user 7a3536012d1444a1b9b606c9ec94e5cf and project 1e8f1e4b9cd9432b90cb00a6be4d909e. Resources: {'key_pairs'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:31:10.031223 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-fb26f1b4-4008-4e53-887b-629199751345 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.044684 May 19 06:31:10.038646 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 13/30] 10.222.0.65 () {60 vars in 1158 bytes} [Thu May 19 06:31:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:31:10.161630 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1d8cade9-0f10-4798-a4ce-69503501a52c tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '184b6909ea6649f3b5eadceef3cca359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d7305d881a4ee29213497d3bab5937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:10.192016 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1d8cade9-0f10-4798-a4ce-69503501a52c tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 200 len: 1315 microversion: 2.1 time: 1.580014 May 19 06:31:10.216260 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 18/31] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:08 2022] GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 1315 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:31:11.235068 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1eae3905-1bf4-409a-bbe8-20660f09d88d tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:11.237686 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-1eae3905-1bf4-409a-bbe8-20660f09d88d tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:11.269204 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1eae3905-1bf4-409a-bbe8-20660f09d88d tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:11.270817 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1eae3905-1bf4-409a-bbe8-20660f09d88d tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:11.273904 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1eae3905-1bf4-409a-bbe8-20660f09d88d tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:11.276344 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1eae3905-1bf4-409a-bbe8-20660f09d88d tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:12.145008 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1eae3905-1bf4-409a-bbe8-20660f09d88d tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '184b6909ea6649f3b5eadceef3cca359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d7305d881a4ee29213497d3bab5937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:12.205810 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-1eae3905-1bf4-409a-bbe8-20660f09d88d tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 200 len: 1315 microversion: 2.1 time: 0.984765 May 19 06:31:12.217192 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 14/32] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:11 2022] GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 1315 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:31:13.067947 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ad2e9e8b-e14c-41f0-abb9-5e1408ea7430 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-622639110", "imageRef": "27959167-098e-44c5-ba0a-e9fb8054c377", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:31:13.247263 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8b6acb47-149d-4368-b0ac-fb1f5e11397d tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:13.266962 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8b6acb47-149d-4368-b0ac-fb1f5e11397d tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:13.317592 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.network.neutron [None req-ad2e9e8b-e14c-41f0-abb9-5e1408ea7430 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] validate_networks() for [('860daf04-4a0a-4379-9eea-a84339c17edf', None, None, None, None, None)] {{(pid=117712) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 06:31:13.340355 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8b6acb47-149d-4368-b0ac-fb1f5e11397d tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:13.345570 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8b6acb47-149d-4368-b0ac-fb1f5e11397d tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:13.346515 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8b6acb47-149d-4368-b0ac-fb1f5e11397d tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:13.347034 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8b6acb47-149d-4368-b0ac-fb1f5e11397d tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:14.471662 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-8b6acb47-149d-4368-b0ac-fb1f5e11397d tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '184b6909ea6649f3b5eadceef3cca359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d7305d881a4ee29213497d3bab5937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:14.562579 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8b6acb47-149d-4368-b0ac-fb1f5e11397d tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 200 len: 1315 microversion: 2.1 time: 1.323641 May 19 06:31:14.572034 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 15/33] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:13 2022] GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 1315 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:15.515332 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a0f048e0-dd46-4227-8f0e-8f0070d7095b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-13165783", "imageRef": "27959167-098e-44c5-ba0a-e9fb8054c377", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ba03612d-d3e3-499d-b899-41fd0fc8db5e"}], "security_groups": [{"name": "tempest-securitygroup--1843122074"}], "key_name": "tempest-keypair-1268562741", "user_data": "}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:31:16.292282 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.network.neutron [None req-a0f048e0-dd46-4227-8f0e-8f0070d7095b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] validate_networks() for [('ba03612d-d3e3-499d-b899-41fd0fc8db5e', None, None, None, None, None)] {{(pid=117711) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 06:31:17.478920 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=4 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:31:18.034216 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:31:18.260621 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-a0f048e0-dd46-4227-8f0e-8f0070d7095b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Flavor limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 06:31:18.261439 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-a0f048e0-dd46-4227-8f0e-8f0070d7095b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Image limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 06:31:18.262417 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-a0f048e0-dd46-4227-8f0e-8f0070d7095b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Flavor pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 06:31:18.263193 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-a0f048e0-dd46-4227-8f0e-8f0070d7095b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Image pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 06:31:18.264053 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-a0f048e0-dd46-4227-8f0e-8f0070d7095b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 06:31:18.305835 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a0f048e0-dd46-4227-8f0e-8f0070d7095b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:18.308561 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a0f048e0-dd46-4227-8f0e-8f0070d7095b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:18.311061 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a0f048e0-dd46-4227-8f0e-8f0070d7095b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:18.352018 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a0f048e0-dd46-4227-8f0e-8f0070d7095b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.041s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:18.440752 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-a0f048e0-dd46-4227-8f0e-8f0070d7095b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Getting quotas for project adbcff8654844c22a906a2e91ebca3bb. Resources: {'ram', 'cores', 'instances'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:31:18.455382 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-a0f048e0-dd46-4227-8f0e-8f0070d7095b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Getting quotas for user cb2bf8531dfe42b29b0b632b39d49625 and project adbcff8654844c22a906a2e91ebca3bb. Resources: {'ram', 'cores', 'instances'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:31:18.515890 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a0f048e0-dd46-4227-8f0e-8f0070d7095b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Going to run 1 instances... {{(pid=117711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 06:31:18.524122 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a0f048e0-dd46-4227-8f0e-8f0070d7095b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27959167-098e-44c5-ba0a-e9fb8054c377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 06:31:18.643524 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a0f048e0-dd46-4227-8f0e-8f0070d7095b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.142257 May 19 06:31:18.651532 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 16/34] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 06:31:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 3152 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 06:31:18.658680 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f721f7fe-f16c-4554-b2df-301ad9376ccc tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:18.659758 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f721f7fe-f16c-4554-b2df-301ad9376ccc tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:18.668739 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f721f7fe-f16c-4554-b2df-301ad9376ccc tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:18.669747 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f721f7fe-f16c-4554-b2df-301ad9376ccc tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:18.671023 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f721f7fe-f16c-4554-b2df-301ad9376ccc tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:18.671959 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f721f7fe-f16c-4554-b2df-301ad9376ccc tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:19.077499 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f721f7fe-f16c-4554-b2df-301ad9376ccc tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '184b6909ea6649f3b5eadceef3cca359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d7305d881a4ee29213497d3bab5937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:19.119039 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f721f7fe-f16c-4554-b2df-301ad9376ccc tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 200 len: 1315 microversion: 2.1 time: 0.465457 May 19 06:31:19.120620 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 17/35] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:18 2022] GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 1315 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:19.144682 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5bfe6177-cdf0-437f-86b5-48b9080d7c2a tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:19.146281 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5bfe6177-cdf0-437f-86b5-48b9080d7c2a tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:19.344317 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5bfe6177-cdf0-437f-86b5-48b9080d7c2a tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:19.360596 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5bfe6177-cdf0-437f-86b5-48b9080d7c2a tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf" status: 200 len: 1240 microversion: 2.1 time: 0.237358 May 19 06:31:19.362081 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 18/36] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:19 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf => generated 1240 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:20.176581 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=24 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:31:20.177875 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-4f38e733-c4e7-49cb-bece-3826296b0c21 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:20.183097 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-4f38e733-c4e7-49cb-bece-3826296b0c21 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:20.248370 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4f38e733-c4e7-49cb-bece-3826296b0c21 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:20.251265 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4f38e733-c4e7-49cb-bece-3826296b0c21 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:20.278216 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4f38e733-c4e7-49cb-bece-3826296b0c21 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:20.284480 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4f38e733-c4e7-49cb-bece-3826296b0c21 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:20.355499 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-ad2e9e8b-e14c-41f0-abb9-5e1408ea7430 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Flavor limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 06:31:20.356383 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-ad2e9e8b-e14c-41f0-abb9-5e1408ea7430 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Image limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 06:31:20.356899 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-ad2e9e8b-e14c-41f0-abb9-5e1408ea7430 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Flavor pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 06:31:20.357533 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-ad2e9e8b-e14c-41f0-abb9-5e1408ea7430 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Image pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 06:31:20.358117 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-ad2e9e8b-e14c-41f0-abb9-5e1408ea7430 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 06:31:20.407692 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ad2e9e8b-e14c-41f0-abb9-5e1408ea7430 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:20.408621 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ad2e9e8b-e14c-41f0-abb9-5e1408ea7430 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:20.409034 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ad2e9e8b-e14c-41f0-abb9-5e1408ea7430 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:20.411674 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ad2e9e8b-e14c-41f0-abb9-5e1408ea7430 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:20.503491 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-ad2e9e8b-e14c-41f0-abb9-5e1408ea7430 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Getting quotas for project 35cb15f2075c41889b91291b645170a5. Resources: {'ram', 'cores', 'instances'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:31:20.525246 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-ad2e9e8b-e14c-41f0-abb9-5e1408ea7430 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Getting quotas for user 6a71c3c016564c3b9ab0b6b58d378fda and project 35cb15f2075c41889b91291b645170a5. Resources: {'ram', 'cores', 'instances'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:31:20.561974 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ad2e9e8b-e14c-41f0-abb9-5e1408ea7430 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Going to run 1 instances... {{(pid=117712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 06:31:20.571527 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ad2e9e8b-e14c-41f0-abb9-5e1408ea7430 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27959167-098e-44c5-ba0a-e9fb8054c377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 06:31:20.765628 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4f38e733-c4e7-49cb-bece-3826296b0c21 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '184b6909ea6649f3b5eadceef3cca359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d7305d881a4ee29213497d3bab5937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:20.773638 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ad2e9e8b-e14c-41f0-abb9-5e1408ea7430 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 9.139295 May 19 06:31:20.779463 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 19/37] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 06:31:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 9141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 06:31:20.783601 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-4f38e733-c4e7-49cb-bece-3826296b0c21 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 200 len: 1315 microversion: 2.1 time: 0.636754 May 19 06:31:20.785553 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 19/38] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:20 2022] GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 1315 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:20.794175 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6228a95d-894f-46bc-9e3e-6e6e0a902aef tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1148377886", "imageRef": "27959167-098e-44c5-ba0a-e9fb8054c377", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e0cb90c-268e-45c0-ad67-af1b766db048"}], "security_groups": [{"name": "tempest-securitygroup--638959248"}], "key_name": "tempest-keypair-1003694897", "user_data": "}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:31:20.797856 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-67df7465-2dc3-4495-a3c5-74ebc10f2d2b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:20.798562 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-67df7465-2dc3-4495-a3c5-74ebc10f2d2b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:20.955997 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-67df7465-2dc3-4495-a3c5-74ebc10f2d2b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:20.967643 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-67df7465-2dc3-4495-a3c5-74ebc10f2d2b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf" status: 200 len: 1240 microversion: 2.1 time: 0.192069 May 19 06:31:20.973551 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 20/39] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:20 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf => generated 1240 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:20.979478 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9958360d-7a78-4d89-8936-e4308c90df78 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:20.980098 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9958360d-7a78-4d89-8936-e4308c90df78 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:21.250935 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.network.neutron [None req-6228a95d-894f-46bc-9e3e-6e6e0a902aef tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] validate_networks() for [('3e0cb90c-268e-45c0-ad67-af1b766db048', None, None, None, None, None)] {{(pid=117711) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 06:31:21.554859 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9958360d-7a78-4d89-8936-e4308c90df78 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:21.595926 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9958360d-7a78-4d89-8936-e4308c90df78 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1221 microversion: 2.1 time: 0.616824 May 19 06:31:21.620167 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 21/40] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:20 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1221 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:21.837095 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-165d81b1-d809-4960-9627-4caed3f7c43f tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:21.839328 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-165d81b1-d809-4960-9627-4caed3f7c43f tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:21.876986 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-165d81b1-d809-4960-9627-4caed3f7c43f tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:21.878455 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-165d81b1-d809-4960-9627-4caed3f7c43f tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:21.894835 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-165d81b1-d809-4960-9627-4caed3f7c43f tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:21.895653 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-165d81b1-d809-4960-9627-4caed3f7c43f tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:22.658678 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-165d81b1-d809-4960-9627-4caed3f7c43f tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '184b6909ea6649f3b5eadceef3cca359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d7305d881a4ee29213497d3bab5937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:22.720896 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-165d81b1-d809-4960-9627-4caed3f7c43f tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 200 len: 1315 microversion: 2.1 time: 0.912354 May 19 06:31:22.729732 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 22/41] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:21 2022] GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 1315 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:31:22.766955 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-27b1f14c-f868-4079-99d5-6e776e43d1a1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:22.768733 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-27b1f14c-f868-4079-99d5-6e776e43d1a1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:22.801064 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-27b1f14c-f868-4079-99d5-6e776e43d1a1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:22.809199 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-27b1f14c-f868-4079-99d5-6e776e43d1a1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:22.813329 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-27b1f14c-f868-4079-99d5-6e776e43d1a1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:22.818330 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-27b1f14c-f868-4079-99d5-6e776e43d1a1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:23.298250 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-27b1f14c-f868-4079-99d5-6e776e43d1a1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:23.309010 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-27b1f14c-f868-4079-99d5-6e776e43d1a1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf" status: 200 len: 1300 microversion: 2.1 time: 0.573248 May 19 06:31:23.318164 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 23/42] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:22 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf => generated 1300 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:23.326126 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-87765b22-fd0d-46f8-bc33-ad0f3b01dd62 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-560308160", "imageRef": "27959167-098e-44c5-ba0a-e9fb8054c377", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:31:23.579056 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.network.neutron [None req-87765b22-fd0d-46f8-bc33-ad0f3b01dd62 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] validate_networks() for [('860daf04-4a0a-4379-9eea-a84339c17edf', None, None, None, None, None)] {{(pid=117712) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 06:31:23.687005 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-6228a95d-894f-46bc-9e3e-6e6e0a902aef tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Flavor limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 06:31:23.688262 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-6228a95d-894f-46bc-9e3e-6e6e0a902aef tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Image limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 06:31:23.689788 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-6228a95d-894f-46bc-9e3e-6e6e0a902aef tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Flavor pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 06:31:23.694305 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-6228a95d-894f-46bc-9e3e-6e6e0a902aef tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Image pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 06:31:23.696570 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-6228a95d-894f-46bc-9e3e-6e6e0a902aef tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 06:31:23.731733 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6228a95d-894f-46bc-9e3e-6e6e0a902aef tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:23.737720 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6228a95d-894f-46bc-9e3e-6e6e0a902aef tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:23.746365 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6228a95d-894f-46bc-9e3e-6e6e0a902aef tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:23.752119 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6228a95d-894f-46bc-9e3e-6e6e0a902aef tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:23.830519 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-6228a95d-894f-46bc-9e3e-6e6e0a902aef tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Getting quotas for project 1e8f1e4b9cd9432b90cb00a6be4d909e. Resources: {'ram', 'cores', 'instances'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:31:23.851757 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-6228a95d-894f-46bc-9e3e-6e6e0a902aef tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Getting quotas for user 7a3536012d1444a1b9b606c9ec94e5cf and project 1e8f1e4b9cd9432b90cb00a6be4d909e. Resources: {'ram', 'cores', 'instances'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:31:23.890012 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6228a95d-894f-46bc-9e3e-6e6e0a902aef tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Going to run 1 instances... {{(pid=117711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 06:31:23.906571 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6228a95d-894f-46bc-9e3e-6e6e0a902aef tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27959167-098e-44c5-ba0a-e9fb8054c377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 06:31:24.162121 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6228a95d-894f-46bc-9e3e-6e6e0a902aef tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.373673 May 19 06:31:24.168823 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 20/43] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 06:31:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 3382 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 06:31:24.179640 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0cf65151-b1bc-4f25-805c-62a1b260c970 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:24.191242 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0cf65151-b1bc-4f25-805c-62a1b260c970 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:24.214298 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0cf65151-b1bc-4f25-805c-62a1b260c970 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:24.215150 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0cf65151-b1bc-4f25-805c-62a1b260c970 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:24.218859 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0cf65151-b1bc-4f25-805c-62a1b260c970 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:24.221177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0cf65151-b1bc-4f25-805c-62a1b260c970 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:24.855200 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0cf65151-b1bc-4f25-805c-62a1b260c970 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '184b6909ea6649f3b5eadceef3cca359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d7305d881a4ee29213497d3bab5937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:24.865493 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0cf65151-b1bc-4f25-805c-62a1b260c970 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 200 len: 1315 microversion: 2.1 time: 0.690648 May 19 06:31:24.879261 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 21/44] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:24 2022] GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 1315 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:24.894855 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-86267905-9e20-4dad-8080-2e31109dc27a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:24.895767 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-86267905-9e20-4dad-8080-2e31109dc27a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:25.065376 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-86267905-9e20-4dad-8080-2e31109dc27a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:25.083372 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-86267905-9e20-4dad-8080-2e31109dc27a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1238 microversion: 2.1 time: 0.202777 May 19 06:31:25.086187 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 22/45] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:24 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1238 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:25.098158 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b0d9a8d7-f679-4104-a5c4-c24d97304eba tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:25.100087 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b0d9a8d7-f679-4104-a5c4-c24d97304eba tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:25.115674 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b0d9a8d7-f679-4104-a5c4-c24d97304eba tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:25.116596 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b0d9a8d7-f679-4104-a5c4-c24d97304eba tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:25.117759 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b0d9a8d7-f679-4104-a5c4-c24d97304eba tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:25.118522 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b0d9a8d7-f679-4104-a5c4-c24d97304eba tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:25.374211 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b0d9a8d7-f679-4104-a5c4-c24d97304eba tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:25.390735 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b0d9a8d7-f679-4104-a5c4-c24d97304eba tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf" status: 200 len: 1298 microversion: 2.1 time: 0.300235 May 19 06:31:25.391536 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 23/46] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:25 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf => generated 1298 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:25.905816 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-894138ab-18d9-4bd1-8c13-51622f842ff8 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:25.911472 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-894138ab-18d9-4bd1-8c13-51622f842ff8 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:25.946283 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-894138ab-18d9-4bd1-8c13-51622f842ff8 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:25.957681 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-894138ab-18d9-4bd1-8c13-51622f842ff8 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:25.958687 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-894138ab-18d9-4bd1-8c13-51622f842ff8 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:25.962712 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-894138ab-18d9-4bd1-8c13-51622f842ff8 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:26.180008 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-87765b22-fd0d-46f8-bc33-ad0f3b01dd62 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Flavor limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 06:31:26.180854 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-87765b22-fd0d-46f8-bc33-ad0f3b01dd62 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Image limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 06:31:26.181239 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-87765b22-fd0d-46f8-bc33-ad0f3b01dd62 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Flavor pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 06:31:26.181693 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-87765b22-fd0d-46f8-bc33-ad0f3b01dd62 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Image pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 06:31:26.182103 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-87765b22-fd0d-46f8-bc33-ad0f3b01dd62 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 06:31:26.215176 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-87765b22-fd0d-46f8-bc33-ad0f3b01dd62 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:26.216142 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-87765b22-fd0d-46f8-bc33-ad0f3b01dd62 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:26.219286 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-87765b22-fd0d-46f8-bc33-ad0f3b01dd62 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:26.219731 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-87765b22-fd0d-46f8-bc33-ad0f3b01dd62 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:26.306130 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-87765b22-fd0d-46f8-bc33-ad0f3b01dd62 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Getting quotas for project 35cb15f2075c41889b91291b645170a5. Resources: {'ram', 'cores', 'instances'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:31:26.319178 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-87765b22-fd0d-46f8-bc33-ad0f3b01dd62 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Getting quotas for user 6a71c3c016564c3b9ab0b6b58d378fda and project 35cb15f2075c41889b91291b645170a5. Resources: {'ram', 'cores', 'instances'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:31:26.365088 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-87765b22-fd0d-46f8-bc33-ad0f3b01dd62 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Going to run 1 instances... {{(pid=117712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 06:31:26.374252 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-87765b22-fd0d-46f8-bc33-ad0f3b01dd62 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27959167-098e-44c5-ba0a-e9fb8054c377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 06:31:26.578738 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-87765b22-fd0d-46f8-bc33-ad0f3b01dd62 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.249037 May 19 06:31:26.580091 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 24/47] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 06:31:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 3261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 06:31:26.619432 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ca34c71a-26ca-40ba-bcc8-f3efc4a7c2c6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:26.619608 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ca34c71a-26ca-40ba-bcc8-f3efc4a7c2c6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:26.655512 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ca34c71a-26ca-40ba-bcc8-f3efc4a7c2c6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:26.656301 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ca34c71a-26ca-40ba-bcc8-f3efc4a7c2c6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:26.664466 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ca34c71a-26ca-40ba-bcc8-f3efc4a7c2c6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:26.666996 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ca34c71a-26ca-40ba-bcc8-f3efc4a7c2c6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:26.806629 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-894138ab-18d9-4bd1-8c13-51622f842ff8 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '184b6909ea6649f3b5eadceef3cca359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d7305d881a4ee29213497d3bab5937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:26.830306 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-894138ab-18d9-4bd1-8c13-51622f842ff8 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 200 len: 1315 microversion: 2.1 time: 0.936683 May 19 06:31:26.830946 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 24/48] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:25 2022] GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 1315 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:26.852299 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-fbaaa1d7-61bd-4d3f-b607-22d3dab5a47c tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:26.853228 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-fbaaa1d7-61bd-4d3f-b607-22d3dab5a47c tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:26.879157 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fbaaa1d7-61bd-4d3f-b607-22d3dab5a47c tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:26.879501 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fbaaa1d7-61bd-4d3f-b607-22d3dab5a47c tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:26.880489 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fbaaa1d7-61bd-4d3f-b607-22d3dab5a47c tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:26.893805 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fbaaa1d7-61bd-4d3f-b607-22d3dab5a47c tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:26.972596 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ca34c71a-26ca-40ba-bcc8-f3efc4a7c2c6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:26.988047 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ca34c71a-26ca-40ba-bcc8-f3efc4a7c2c6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1308 microversion: 2.1 time: 0.405632 May 19 06:31:26.991302 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 25/49] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:26 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1308 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:27.010777 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-14a6af87-0ae1-4a04-bee9-9029406ea5d5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:27.013000 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-14a6af87-0ae1-4a04-bee9-9029406ea5d5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:27.651666 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-14a6af87-0ae1-4a04-bee9-9029406ea5d5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:27.666749 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-14a6af87-0ae1-4a04-bee9-9029406ea5d5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1221 microversion: 2.1 time: 0.673865 May 19 06:31:27.676514 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 26/50] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:26 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1221 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:27.715702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-fbaaa1d7-61bd-4d3f-b607-22d3dab5a47c tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:27.732999 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-fbaaa1d7-61bd-4d3f-b607-22d3dab5a47c tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf" status: 200 len: 1366 microversion: 2.1 time: 0.895899 May 19 06:31:27.733758 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 25/51] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:26 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf => generated 1366 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:27.848520 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ab8ed268-21be-4112-b948-b9ea7d910498 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:27.849143 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ab8ed268-21be-4112-b948-b9ea7d910498 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:27.861098 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ab8ed268-21be-4112-b948-b9ea7d910498 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:27.862308 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ab8ed268-21be-4112-b948-b9ea7d910498 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:27.864934 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ab8ed268-21be-4112-b948-b9ea7d910498 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:27.866782 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ab8ed268-21be-4112-b948-b9ea7d910498 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:28.203570 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-b9411525-eac7-4e1b-b170-dde97fa2ee22 req-68098753-8c54-40b9-9b77-8f585fec3af0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bfcd957-5a5f-4c7b-81ea-61c732fc3354", "name": "network-vif-plugged", "status": "completed", "tag": "946cfd64-c054-41e4-aadd-9b6bf0f436f8"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:31:28.229606 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-b9411525-eac7-4e1b-b170-dde97fa2ee22 req-68098753-8c54-40b9-9b77-8f585fec3af0 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:28.230068 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-b9411525-eac7-4e1b-b170-dde97fa2ee22 req-68098753-8c54-40b9-9b77-8f585fec3af0 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:28.271049 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-b9411525-eac7-4e1b-b170-dde97fa2ee22 req-68098753-8c54-40b9-9b77-8f585fec3af0 service nova] Creating event network-vif-plugged:946cfd64-c054-41e4-aadd-9b6bf0f436f8 for instance 7bfcd957-5a5f-4c7b-81ea-61c732fc3354 on hv-cinder-83699 May 19 06:31:28.277344 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-b9411525-eac7-4e1b-b170-dde97fa2ee22 req-68098753-8c54-40b9-9b77-8f585fec3af0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117712) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 06:31:28.278984 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7cb1be37-230a-4ab5-93cd-dcc4e9d77b02 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:28.279641 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7cb1be37-230a-4ab5-93cd-dcc4e9d77b02 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:28.280901 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7cb1be37-230a-4ab5-93cd-dcc4e9d77b02 None None] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:28.281370 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7cb1be37-230a-4ab5-93cd-dcc4e9d77b02 None None] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:28.306473 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.compute.rpcapi [None req-7cb1be37-230a-4ab5-93cd-dcc4e9d77b02 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 19 06:31:28.307741 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7cb1be37-230a-4ab5-93cd-dcc4e9d77b02 None None] Releasing lock "compute-rpcapi-router" {{(pid=117712) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 06:31:28.395083 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7cb1be37-230a-4ab5-93cd-dcc4e9d77b02 None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.716485 May 19 06:31:28.400076 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 27/52] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:31:28.444697 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b48e01d5-d9b9-40d1-a948-c62623bbd9df tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:28.447636 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b48e01d5-d9b9-40d1-a948-c62623bbd9df tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:28.480337 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b48e01d5-d9b9-40d1-a948-c62623bbd9df tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:28.483306 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b48e01d5-d9b9-40d1-a948-c62623bbd9df tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:28.486345 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b48e01d5-d9b9-40d1-a948-c62623bbd9df tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:28.488482 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b48e01d5-d9b9-40d1-a948-c62623bbd9df tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:28.544066 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ab8ed268-21be-4112-b948-b9ea7d910498 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '184b6909ea6649f3b5eadceef3cca359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d7305d881a4ee29213497d3bab5937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:28.564132 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ab8ed268-21be-4112-b948-b9ea7d910498 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 200 len: 1315 microversion: 2.1 time: 0.719485 May 19 06:31:28.575055 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 26/53] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:27 2022] GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 1315 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:31:28.689904 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-4de45abc-bd5d-4cca-a600-b9d2563fbcf8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:28.690678 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-4de45abc-bd5d-4cca-a600-b9d2563fbcf8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:28.722863 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4de45abc-bd5d-4cca-a600-b9d2563fbcf8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:28.726490 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4de45abc-bd5d-4cca-a600-b9d2563fbcf8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:28.728639 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4de45abc-bd5d-4cca-a600-b9d2563fbcf8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:28.732956 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4de45abc-bd5d-4cca-a600-b9d2563fbcf8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:28.837045 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b48e01d5-d9b9-40d1-a948-c62623bbd9df tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:28.856837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b48e01d5-d9b9-40d1-a948-c62623bbd9df tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1296 microversion: 2.1 time: 0.450750 May 19 06:31:28.875478 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 28/54] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:28 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1296 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:28.889222 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6370aabe-74f5-4d30-a255-103999afcf73 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:28.894528 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-6370aabe-74f5-4d30-a255-103999afcf73 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:28.908957 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6370aabe-74f5-4d30-a255-103999afcf73 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:28.910449 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6370aabe-74f5-4d30-a255-103999afcf73 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:28.912101 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6370aabe-74f5-4d30-a255-103999afcf73 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:28.913688 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6370aabe-74f5-4d30-a255-103999afcf73 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:28.983693 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4de45abc-bd5d-4cca-a600-b9d2563fbcf8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:29.018365 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-4de45abc-bd5d-4cca-a600-b9d2563fbcf8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1273 microversion: 2.1 time: 0.334649 May 19 06:31:29.020645 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 27/55] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:28 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1273 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:29.593140 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ff3f116f-0d53-42ad-940d-2dedd2a8ccc1 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:29.593994 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ff3f116f-0d53-42ad-940d-2dedd2a8ccc1 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:29.607140 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ff3f116f-0d53-42ad-940d-2dedd2a8ccc1 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:29.607673 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ff3f116f-0d53-42ad-940d-2dedd2a8ccc1 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:29.610397 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ff3f116f-0d53-42ad-940d-2dedd2a8ccc1 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:29.611160 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ff3f116f-0d53-42ad-940d-2dedd2a8ccc1 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:29.745072 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6370aabe-74f5-4d30-a255-103999afcf73 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:29.753736 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6370aabe-74f5-4d30-a255-103999afcf73 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf" status: 200 len: 1366 microversion: 2.1 time: 0.876534 May 19 06:31:29.777854 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 29/56] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:28 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf => generated 1366 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:29.824160 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-3dfe8586-45a3-4a29-ac9e-1d9c2a48f83d req-d039eb72-941b-49dd-8490-e66f21444bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27482c04-b2af-4f4a-be37-655969d386cf", "tag": "cb1871e1-4ddc-43af-a6f0-08f3745f2edf"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:31:29.839622 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-3dfe8586-45a3-4a29-ac9e-1d9c2a48f83d req-d039eb72-941b-49dd-8490-e66f21444bd8 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:29.841979 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-3dfe8586-45a3-4a29-ac9e-1d9c2a48f83d req-d039eb72-941b-49dd-8490-e66f21444bd8 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:29.857501 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-3dfe8586-45a3-4a29-ac9e-1d9c2a48f83d req-d039eb72-941b-49dd-8490-e66f21444bd8 service nova] Creating event network-changed:cb1871e1-4ddc-43af-a6f0-08f3745f2edf for instance 27482c04-b2af-4f4a-be37-655969d386cf on hv-cinder-83699 May 19 06:31:29.871226 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-3dfe8586-45a3-4a29-ac9e-1d9c2a48f83d req-d039eb72-941b-49dd-8490-e66f21444bd8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055035 May 19 06:31:29.873410 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 30/57] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:31:29.891342 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-80cde090-7904-48b6-8d3c-364ddb6b173c tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:29.894955 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-80cde090-7904-48b6-8d3c-364ddb6b173c tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:29.924719 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-80cde090-7904-48b6-8d3c-364ddb6b173c tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:29.925226 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-80cde090-7904-48b6-8d3c-364ddb6b173c tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:29.926109 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-80cde090-7904-48b6-8d3c-364ddb6b173c tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:29.926713 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-80cde090-7904-48b6-8d3c-364ddb6b173c tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:30.301215 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-80cde090-7904-48b6-8d3c-364ddb6b173c tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:30.370398 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-80cde090-7904-48b6-8d3c-364ddb6b173c tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1296 microversion: 2.1 time: 0.467285 May 19 06:31:30.376325 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 31/58] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:29 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1296 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:31:30.402383 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ff3f116f-0d53-42ad-940d-2dedd2a8ccc1 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '184b6909ea6649f3b5eadceef3cca359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d7305d881a4ee29213497d3bab5937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:30.403556 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e2f57e02-1b2b-4c74-a54d-eb3ae0564b72 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:30.404953 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e2f57e02-1b2b-4c74-a54d-eb3ae0564b72 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:30.419430 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e2f57e02-1b2b-4c74-a54d-eb3ae0564b72 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:30.420147 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e2f57e02-1b2b-4c74-a54d-eb3ae0564b72 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:30.422094 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e2f57e02-1b2b-4c74-a54d-eb3ae0564b72 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:30.422890 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e2f57e02-1b2b-4c74-a54d-eb3ae0564b72 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:30.433845 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ff3f116f-0d53-42ad-940d-2dedd2a8ccc1 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 200 len: 1315 microversion: 2.1 time: 0.844705 May 19 06:31:30.436020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 28/59] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:29 2022] GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 1315 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:30.778460 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-71f055a6-6ec2-4233-ad09-a5d4e96f1ff7 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:30.779332 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-71f055a6-6ec2-4233-ad09-a5d4e96f1ff7 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:30.795898 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-71f055a6-6ec2-4233-ad09-a5d4e96f1ff7 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:30.797800 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-71f055a6-6ec2-4233-ad09-a5d4e96f1ff7 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:30.800586 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-71f055a6-6ec2-4233-ad09-a5d4e96f1ff7 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:30.802018 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-71f055a6-6ec2-4233-ad09-a5d4e96f1ff7 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:30.820925 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e2f57e02-1b2b-4c74-a54d-eb3ae0564b72 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:30.833796 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e2f57e02-1b2b-4c74-a54d-eb3ae0564b72 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1279 microversion: 2.1 time: 0.454971 May 19 06:31:30.835198 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 32/60] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:30 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1279 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:31.401703 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-5770daf1-5580-4cd5-8665-2adca9500ab6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:31.403075 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-5770daf1-5580-4cd5-8665-2adca9500ab6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:31.430126 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5770daf1-5580-4cd5-8665-2adca9500ab6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:31.434630 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5770daf1-5580-4cd5-8665-2adca9500ab6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:31.437007 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5770daf1-5580-4cd5-8665-2adca9500ab6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:31.438134 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5770daf1-5580-4cd5-8665-2adca9500ab6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:32.308950 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-71f055a6-6ec2-4233-ad09-a5d4e96f1ff7 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:32.321152 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-71f055a6-6ec2-4233-ad09-a5d4e96f1ff7 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf" status: 200 len: 1366 microversion: 2.1 time: 1.546798 May 19 06:31:32.322982 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 29/61] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:30 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf => generated 1366 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:32.338251 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-43a1a6a8-1edd-4381-9348-f90317e07f13 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:32.339360 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-43a1a6a8-1edd-4381-9348-f90317e07f13 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:32.358857 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-43a1a6a8-1edd-4381-9348-f90317e07f13 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:32.361244 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-43a1a6a8-1edd-4381-9348-f90317e07f13 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:32.362147 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-43a1a6a8-1edd-4381-9348-f90317e07f13 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:32.362596 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-43a1a6a8-1edd-4381-9348-f90317e07f13 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:32.468450 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-5770daf1-5580-4cd5-8665-2adca9500ab6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:32.481101 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-5770daf1-5580-4cd5-8665-2adca9500ab6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1363 microversion: 2.1 time: 1.085746 May 19 06:31:32.484349 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 33/62] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:31 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1363 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:32.502256 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-02705f00-4f9a-45a0-9db2-4faacf71c515 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:32.506118 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-02705f00-4f9a-45a0-9db2-4faacf71c515 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:32.531942 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-02705f00-4f9a-45a0-9db2-4faacf71c515 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:32.538932 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-02705f00-4f9a-45a0-9db2-4faacf71c515 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:32.540734 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-02705f00-4f9a-45a0-9db2-4faacf71c515 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:32.542206 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-02705f00-4f9a-45a0-9db2-4faacf71c515 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:32.765892 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-43a1a6a8-1edd-4381-9348-f90317e07f13 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '184b6909ea6649f3b5eadceef3cca359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d7305d881a4ee29213497d3bab5937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:32.801272 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-43a1a6a8-1edd-4381-9348-f90317e07f13 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 200 len: 1502 microversion: 2.1 time: 0.475972 May 19 06:31:32.819067 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 30/63] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:32 2022] GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 1502 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:33.018527 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-02705f00-4f9a-45a0-9db2-4faacf71c515 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:33.033111 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-02705f00-4f9a-45a0-9db2-4faacf71c515 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1279 microversion: 2.1 time: 0.542538 May 19 06:31:33.038906 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 34/64] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:32 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1279 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:33.385234 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-57b6927b-d298-4e59-8864-d69b92c44752 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:33.387339 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-57b6927b-d298-4e59-8864-d69b92c44752 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:33.413643 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-57b6927b-d298-4e59-8864-d69b92c44752 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:33.415832 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-57b6927b-d298-4e59-8864-d69b92c44752 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:33.416976 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-57b6927b-d298-4e59-8864-d69b92c44752 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:33.418204 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-57b6927b-d298-4e59-8864-d69b92c44752 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:33.530664 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9cf6fd3c-9c2e-4605-b10e-b78066c2baff tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:33.531662 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9cf6fd3c-9c2e-4605-b10e-b78066c2baff tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:33.550872 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9cf6fd3c-9c2e-4605-b10e-b78066c2baff tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:33.551925 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9cf6fd3c-9c2e-4605-b10e-b78066c2baff tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:33.555478 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9cf6fd3c-9c2e-4605-b10e-b78066c2baff tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:33.556390 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9cf6fd3c-9c2e-4605-b10e-b78066c2baff tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:33.782440 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=4 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:31:34.114442 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-57b6927b-d298-4e59-8864-d69b92c44752 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:34.134749 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-57b6927b-d298-4e59-8864-d69b92c44752 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf" status: 200 len: 1366 microversion: 2.1 time: 0.783087 May 19 06:31:34.139999 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 31/65] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:33 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf => generated 1366 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:34.670050 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-d760e906-c5b1-40b7-9e04-d5da1881436b req-07032b98-1925-49d3-b65f-504cfb27953c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f4202e4-0d0b-4d78-b9e3-a8e529700d8e", "tag": "7b1f2836-944c-46f7-af0c-4d51b0b73e65"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:31:34.687891 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-d760e906-c5b1-40b7-9e04-d5da1881436b req-07032b98-1925-49d3-b65f-504cfb27953c service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:34.688598 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-d760e906-c5b1-40b7-9e04-d5da1881436b req-07032b98-1925-49d3-b65f-504cfb27953c service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:34.697159 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9cf6fd3c-9c2e-4605-b10e-b78066c2baff tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:34.705844 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=100 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:31:34.712908 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9cf6fd3c-9c2e-4605-b10e-b78066c2baff tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1363 microversion: 2.1 time: 1.196419 May 19 06:31:34.716322 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 35/66] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:33 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1363 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:34.726389 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-d760e906-c5b1-40b7-9e04-d5da1881436b req-07032b98-1925-49d3-b65f-504cfb27953c service nova] Creating event network-changed:7b1f2836-944c-46f7-af0c-4d51b0b73e65 for instance 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e on hv-cinder-83699 May 19 06:31:34.729543 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d345d32b-932d-444e-9cda-2cf6bc766b68 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:34.730372 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d345d32b-932d-444e-9cda-2cf6bc766b68 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:34.733749 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-d760e906-c5b1-40b7-9e04-d5da1881436b req-07032b98-1925-49d3-b65f-504cfb27953c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.591719 May 19 06:31:34.735031 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 32/67] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:31:34.747486 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d345d32b-932d-444e-9cda-2cf6bc766b68 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:34.749679 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d345d32b-932d-444e-9cda-2cf6bc766b68 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:34.750751 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d345d32b-932d-444e-9cda-2cf6bc766b68 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:34.751311 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d345d32b-932d-444e-9cda-2cf6bc766b68 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:35.030214 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-52fb1579-a12d-4959-a35a-1c9ad6c20703 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca751de0-966f-4fc0-83a7-da29b6554157"}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:31:35.034467 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-52fb1579-a12d-4959-a35a-1c9ad6c20703 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:35.050111 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-52fb1579-a12d-4959-a35a-1c9ad6c20703 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:35.055518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-52fb1579-a12d-4959-a35a-1c9ad6c20703 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:35.061263 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-52fb1579-a12d-4959-a35a-1c9ad6c20703 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:35.062322 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-52fb1579-a12d-4959-a35a-1c9ad6c20703 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:35.142310 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=20 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:31:35.455647 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d345d32b-932d-444e-9cda-2cf6bc766b68 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:35.474534 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d345d32b-932d-444e-9cda-2cf6bc766b68 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1321 microversion: 2.1 time: 0.756660 May 19 06:31:35.480293 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 36/68] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:34 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1321 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:35.498851 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-86f64fa7-739c-4230-9afa-299e83e0a944 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:35.503478 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-86f64fa7-739c-4230-9afa-299e83e0a944 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:35.528908 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-86f64fa7-739c-4230-9afa-299e83e0a944 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:35.530293 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-86f64fa7-739c-4230-9afa-299e83e0a944 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:35.534215 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-86f64fa7-739c-4230-9afa-299e83e0a944 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:35.536359 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-86f64fa7-739c-4230-9afa-299e83e0a944 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:36.041904 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-86f64fa7-739c-4230-9afa-299e83e0a944 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:36.066035 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-86f64fa7-739c-4230-9afa-299e83e0a944 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf" status: 200 len: 1366 microversion: 2.1 time: 0.581497 May 19 06:31:36.066778 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 37/69] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:35 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf => generated 1366 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:36.085130 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-16206d68-0d3b-4557-93aa-f4072bf12486 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:36.086335 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-16206d68-0d3b-4557-93aa-f4072bf12486 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:36.100489 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-16206d68-0d3b-4557-93aa-f4072bf12486 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:36.101396 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-16206d68-0d3b-4557-93aa-f4072bf12486 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:36.102739 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-16206d68-0d3b-4557-93aa-f4072bf12486 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:36.103429 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-16206d68-0d3b-4557-93aa-f4072bf12486 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:36.649674 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-52fb1579-a12d-4959-a35a-1c9ad6c20703 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "POST /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.621782 May 19 06:31:36.657951 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 33/70] 10.222.0.65 () {60 vars in 1322 bytes} [Thu May 19 06:31:35 2022] POST /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354/os-volume_attachments => generated 194 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:31:36.679404 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a541bb5c-377b-4bed-8e59-6e77f37e672a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:36.686710 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a541bb5c-377b-4bed-8e59-6e77f37e672a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:36.718637 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a541bb5c-377b-4bed-8e59-6e77f37e672a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:36.719889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a541bb5c-377b-4bed-8e59-6e77f37e672a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:36.726770 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a541bb5c-377b-4bed-8e59-6e77f37e672a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:36.732431 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a541bb5c-377b-4bed-8e59-6e77f37e672a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:37.342193 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-16206d68-0d3b-4557-93aa-f4072bf12486 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:37.366789 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-16206d68-0d3b-4557-93aa-f4072bf12486 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1363 microversion: 2.1 time: 1.296038 May 19 06:31:37.369212 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 38/71] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:36 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1363 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:37.384140 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-96c7e08f-cc4f-494d-986c-39d17fc42c12 req-d4f378e7-ff95-4a6b-b91b-a7d2398b2b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27482c04-b2af-4f4a-be37-655969d386cf", "name": "network-vif-plugged", "status": "completed", "tag": "cb1871e1-4ddc-43af-a6f0-08f3745f2edf"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:31:37.409824 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:31:37.414625 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-96c7e08f-cc4f-494d-986c-39d17fc42c12 req-d4f378e7-ff95-4a6b-b91b-a7d2398b2b94 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:37.415844 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-96c7e08f-cc4f-494d-986c-39d17fc42c12 req-d4f378e7-ff95-4a6b-b91b-a7d2398b2b94 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:37.461890 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-96c7e08f-cc4f-494d-986c-39d17fc42c12 req-d4f378e7-ff95-4a6b-b91b-a7d2398b2b94 service nova] Creating event network-vif-plugged:cb1871e1-4ddc-43af-a6f0-08f3745f2edf for instance 27482c04-b2af-4f4a-be37-655969d386cf on hv-cinder-83699 May 19 06:31:37.474210 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-96c7e08f-cc4f-494d-986c-39d17fc42c12 req-d4f378e7-ff95-4a6b-b91b-a7d2398b2b94 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099797 May 19 06:31:37.478156 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 39/72] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:31:37.493727 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-c8de78fa-f7e0-474c-8e84-a7ffc490b08c req-5c8e42e5-4e49-4537-9628-865c95ff6c55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab7664a1-4da9-4338-996f-82bf458729ac", "tag": "a273e96a-f26e-4d91-b813-288465dd486f"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:31:37.503208 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a541bb5c-377b-4bed-8e59-6e77f37e672a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:37.515823 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a541bb5c-377b-4bed-8e59-6e77f37e672a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1321 microversion: 2.1 time: 0.855338 May 19 06:31:37.521128 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-c8de78fa-f7e0-474c-8e84-a7ffc490b08c req-5c8e42e5-4e49-4537-9628-865c95ff6c55 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:37.521916 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-c8de78fa-f7e0-474c-8e84-a7ffc490b08c req-5c8e42e5-4e49-4537-9628-865c95ff6c55 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:37.526676 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 34/73] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:36 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1321 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:37.532504 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-4194bc66-976d-4c33-94fa-3955349897e1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:37.535902 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-4194bc66-976d-4c33-94fa-3955349897e1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:37.547563 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-c8de78fa-f7e0-474c-8e84-a7ffc490b08c req-5c8e42e5-4e49-4537-9628-865c95ff6c55 service nova] Creating event network-changed:a273e96a-f26e-4d91-b813-288465dd486f for instance ab7664a1-4da9-4338-996f-82bf458729ac on hv-cinder-83699 May 19 06:31:37.547936 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:31:37.571716 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-c8de78fa-f7e0-474c-8e84-a7ffc490b08c req-5c8e42e5-4e49-4537-9628-865c95ff6c55 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087435 May 19 06:31:37.574899 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4194bc66-976d-4c33-94fa-3955349897e1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:37.575689 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 40/74] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:31:37.577977 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4194bc66-976d-4c33-94fa-3955349897e1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:37.578853 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4194bc66-976d-4c33-94fa-3955349897e1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:37.581817 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4194bc66-976d-4c33-94fa-3955349897e1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:37.899596 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-34d8b115-e8b8-400b-9028-5fc0ffb97f61 req-0f615ac9-d42a-4b99-a09e-84f3b52dcf55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88cd1ef9-5ec7-42ca-9204-dded848822ae", "tag": "06df601d-f75d-4b75-b340-1e3f3982ca58"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:31:37.915436 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4194bc66-976d-4c33-94fa-3955349897e1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:37.933030 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-4194bc66-976d-4c33-94fa-3955349897e1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf" status: 200 len: 1366 microversion: 2.1 time: 0.402562 May 19 06:31:37.937383 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 35/75] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:37 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf => generated 1366 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:37.944674 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=18 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:31:37.950580 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-34d8b115-e8b8-400b-9028-5fc0ffb97f61 req-0f615ac9-d42a-4b99-a09e-84f3b52dcf55 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:37.953373 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-34d8b115-e8b8-400b-9028-5fc0ffb97f61 req-0f615ac9-d42a-4b99-a09e-84f3b52dcf55 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:37.972386 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-34d8b115-e8b8-400b-9028-5fc0ffb97f61 req-0f615ac9-d42a-4b99-a09e-84f3b52dcf55 service nova] Creating event network-changed:06df601d-f75d-4b75-b340-1e3f3982ca58 for instance 88cd1ef9-5ec7-42ca-9204-dded848822ae on hv-cinder-83699 May 19 06:31:37.979320 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-34d8b115-e8b8-400b-9028-5fc0ffb97f61 req-0f615ac9-d42a-4b99-a09e-84f3b52dcf55 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094258 May 19 06:31:37.981043 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 41/76] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:31:38.407470 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ebd0ccbc-8a45-4545-9eb3-933315d71bd5 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:38.408253 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ebd0ccbc-8a45-4545-9eb3-933315d71bd5 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:38.425353 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ebd0ccbc-8a45-4545-9eb3-933315d71bd5 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:38.425815 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ebd0ccbc-8a45-4545-9eb3-933315d71bd5 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:38.426655 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ebd0ccbc-8a45-4545-9eb3-933315d71bd5 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:38.427097 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ebd0ccbc-8a45-4545-9eb3-933315d71bd5 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:38.554266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=6 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:31:38.574952 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-8f8e4f4e-0b6e-444c-8b26-cd714edfd59f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:38.576356 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-8f8e4f4e-0b6e-444c-8b26-cd714edfd59f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:38.602941 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8f8e4f4e-0b6e-444c-8b26-cd714edfd59f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:38.603578 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8f8e4f4e-0b6e-444c-8b26-cd714edfd59f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:38.604775 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8f8e4f4e-0b6e-444c-8b26-cd714edfd59f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:38.605544 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8f8e4f4e-0b6e-444c-8b26-cd714edfd59f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:38.698286 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ebd0ccbc-8a45-4545-9eb3-933315d71bd5 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:38.729191 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ebd0ccbc-8a45-4545-9eb3-933315d71bd5 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1363 microversion: 2.1 time: 0.332683 May 19 06:31:38.730351 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 36/77] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:38 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1363 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:38.882969 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8f8e4f4e-0b6e-444c-8b26-cd714edfd59f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:38.887942 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=100 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:31:38.898636 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-8f8e4f4e-0b6e-444c-8b26-cd714edfd59f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1321 microversion: 2.1 time: 0.346340 May 19 06:31:38.900345 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 42/78] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:38 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:38.961022 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b5e1d377-4f40-4bd9-8a28-75ddbd2288e1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:38.962367 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b5e1d377-4f40-4bd9-8a28-75ddbd2288e1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:38.974891 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b5e1d377-4f40-4bd9-8a28-75ddbd2288e1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:38.976924 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b5e1d377-4f40-4bd9-8a28-75ddbd2288e1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:38.978621 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b5e1d377-4f40-4bd9-8a28-75ddbd2288e1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:38.979534 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b5e1d377-4f40-4bd9-8a28-75ddbd2288e1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:39.280489 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b5e1d377-4f40-4bd9-8a28-75ddbd2288e1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:39.289903 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b5e1d377-4f40-4bd9-8a28-75ddbd2288e1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf" status: 200 len: 1366 microversion: 2.1 time: 0.336864 May 19 06:31:39.290511 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 37/79] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:38 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf => generated 1366 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:39.760354 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0c8bef9c-924e-4080-8cdc-d7daeb82072b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:39.761165 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0c8bef9c-924e-4080-8cdc-d7daeb82072b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:39.769042 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0c8bef9c-924e-4080-8cdc-d7daeb82072b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:39.769852 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0c8bef9c-924e-4080-8cdc-d7daeb82072b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:39.770804 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0c8bef9c-924e-4080-8cdc-d7daeb82072b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:39.772106 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0c8bef9c-924e-4080-8cdc-d7daeb82072b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:39.930314 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6e95df38-7b15-478a-be9b-f2af3700adcd tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:39.931279 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6e95df38-7b15-478a-be9b-f2af3700adcd tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:39.940877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6e95df38-7b15-478a-be9b-f2af3700adcd tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:39.941387 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6e95df38-7b15-478a-be9b-f2af3700adcd tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:39.942712 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6e95df38-7b15-478a-be9b-f2af3700adcd tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:39.944430 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6e95df38-7b15-478a-be9b-f2af3700adcd tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:39.988514 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0c8bef9c-924e-4080-8cdc-d7daeb82072b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:40.000918 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0c8bef9c-924e-4080-8cdc-d7daeb82072b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1363 microversion: 2.1 time: 0.246624 May 19 06:31:40.002367 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 43/80] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:39 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:40.126487 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6e95df38-7b15-478a-be9b-f2af3700adcd tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:40.142364 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6e95df38-7b15-478a-be9b-f2af3700adcd tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1321 microversion: 2.1 time: 0.218942 May 19 06:31:40.143746 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 38/81] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:39 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:40.309234 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4f490aba-ff20-474c-b98b-3c3ae75b2286 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:40.309884 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4f490aba-ff20-474c-b98b-3c3ae75b2286 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:40.325746 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4f490aba-ff20-474c-b98b-3c3ae75b2286 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:40.326975 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4f490aba-ff20-474c-b98b-3c3ae75b2286 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:40.329215 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4f490aba-ff20-474c-b98b-3c3ae75b2286 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:40.330180 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4f490aba-ff20-474c-b98b-3c3ae75b2286 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:41.041256 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e6d05107-a0b6-41f1-9de0-e5c970dda0fe tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:41.044988 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e6d05107-a0b6-41f1-9de0-e5c970dda0fe tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:41.074984 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e6d05107-a0b6-41f1-9de0-e5c970dda0fe tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:41.076324 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e6d05107-a0b6-41f1-9de0-e5c970dda0fe tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:41.078611 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e6d05107-a0b6-41f1-9de0-e5c970dda0fe tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:41.090385 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e6d05107-a0b6-41f1-9de0-e5c970dda0fe tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:41.100374 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-4f490aba-ff20-474c-b98b-3c3ae75b2286 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:41.138637 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4f490aba-ff20-474c-b98b-3c3ae75b2286 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf" status: 200 len: 1366 microversion: 2.1 time: 0.832808 May 19 06:31:41.139746 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 44/82] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:40 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf => generated 1366 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:41.165652 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f84083b4-d225-4a84-b552-eaffcab8ece6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:41.166838 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f84083b4-d225-4a84-b552-eaffcab8ece6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:41.188896 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f84083b4-d225-4a84-b552-eaffcab8ece6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:41.189597 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f84083b4-d225-4a84-b552-eaffcab8ece6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:41.191005 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f84083b4-d225-4a84-b552-eaffcab8ece6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:41.191803 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f84083b4-d225-4a84-b552-eaffcab8ece6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:41.588030 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e6d05107-a0b6-41f1-9de0-e5c970dda0fe tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:41.603278 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e6d05107-a0b6-41f1-9de0-e5c970dda0fe tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1363 microversion: 2.1 time: 0.585305 May 19 06:31:41.617776 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 39/83] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:41 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1363 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:41.760557 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f84083b4-d225-4a84-b552-eaffcab8ece6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:41.770582 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f84083b4-d225-4a84-b552-eaffcab8ece6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1321 microversion: 2.1 time: 0.612036 May 19 06:31:41.772522 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 45/84] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:41 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1321 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:42.163444 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-34f8b4ee-0c0a-464b-85dd-6fcefe46db82 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:42.163444 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-34f8b4ee-0c0a-464b-85dd-6fcefe46db82 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:42.177981 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-34f8b4ee-0c0a-464b-85dd-6fcefe46db82 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:42.178222 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-34f8b4ee-0c0a-464b-85dd-6fcefe46db82 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:42.179253 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-34f8b4ee-0c0a-464b-85dd-6fcefe46db82 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:42.179745 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-34f8b4ee-0c0a-464b-85dd-6fcefe46db82 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:42.574885 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-34f8b4ee-0c0a-464b-85dd-6fcefe46db82 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:42.586566 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-34f8b4ee-0c0a-464b-85dd-6fcefe46db82 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf" status: 200 len: 1366 microversion: 2.1 time: 0.432426 May 19 06:31:42.587873 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 40/85] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:42 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf => generated 1366 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:42.623679 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-83257e30-cba4-4dbe-9d6c-4025851f234b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:42.625454 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-83257e30-cba4-4dbe-9d6c-4025851f234b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:42.640607 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-83257e30-cba4-4dbe-9d6c-4025851f234b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:42.640953 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-83257e30-cba4-4dbe-9d6c-4025851f234b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:42.643081 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-83257e30-cba4-4dbe-9d6c-4025851f234b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:42.644588 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-83257e30-cba4-4dbe-9d6c-4025851f234b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:42.792574 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e6abd738-29c2-421a-aca7-c763a2809c3c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:42.794480 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e6abd738-29c2-421a-aca7-c763a2809c3c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:42.805459 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e6abd738-29c2-421a-aca7-c763a2809c3c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:42.806544 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e6abd738-29c2-421a-aca7-c763a2809c3c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:42.807606 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e6abd738-29c2-421a-aca7-c763a2809c3c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:42.808837 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e6abd738-29c2-421a-aca7-c763a2809c3c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:43.059983 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e6abd738-29c2-421a-aca7-c763a2809c3c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:43.070985 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e6abd738-29c2-421a-aca7-c763a2809c3c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1321 microversion: 2.1 time: 0.284931 May 19 06:31:43.072362 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 41/86] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:42 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1321 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:31:43.115376 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-83257e30-cba4-4dbe-9d6c-4025851f234b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:43.127856 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-83257e30-cba4-4dbe-9d6c-4025851f234b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1363 microversion: 2.1 time: 0.509060 May 19 06:31:43.128480 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 46/87] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:42 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1363 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:31:43.606958 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5fc3eead-2401-4ac6-8eb5-a8a74be97b64 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:43.610112 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5fc3eead-2401-4ac6-8eb5-a8a74be97b64 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:43.635049 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5fc3eead-2401-4ac6-8eb5-a8a74be97b64 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:43.636232 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5fc3eead-2401-4ac6-8eb5-a8a74be97b64 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:43.639974 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5fc3eead-2401-4ac6-8eb5-a8a74be97b64 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:43.641153 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5fc3eead-2401-4ac6-8eb5-a8a74be97b64 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:44.099314 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9eaad877-f2b2-415a-a93c-92caa2ed4071 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:44.101437 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9eaad877-f2b2-415a-a93c-92caa2ed4071 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:44.128621 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9eaad877-f2b2-415a-a93c-92caa2ed4071 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:44.151553 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9eaad877-f2b2-415a-a93c-92caa2ed4071 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:44.153657 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5fc3eead-2401-4ac6-8eb5-a8a74be97b64 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:44.159650 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9eaad877-f2b2-415a-a93c-92caa2ed4071 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:44.162388 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9eaad877-f2b2-415a-a93c-92caa2ed4071 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:44.169073 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5fc3eead-2401-4ac6-8eb5-a8a74be97b64 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf" status: 200 len: 1366 microversion: 2.1 time: 0.567784 May 19 06:31:44.172734 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 42/88] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:43 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf => generated 1366 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:31:44.186062 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c7d54fa5-a4aa-4044-be7a-08f3b8c99df6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:44.186744 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c7d54fa5-a4aa-4044-be7a-08f3b8c99df6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:44.205454 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c7d54fa5-a4aa-4044-be7a-08f3b8c99df6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:44.206991 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c7d54fa5-a4aa-4044-be7a-08f3b8c99df6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:44.208557 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c7d54fa5-a4aa-4044-be7a-08f3b8c99df6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:44.209447 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c7d54fa5-a4aa-4044-be7a-08f3b8c99df6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:44.641617 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9eaad877-f2b2-415a-a93c-92caa2ed4071 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:44.651226 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c7d54fa5-a4aa-4044-be7a-08f3b8c99df6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:44.655588 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9eaad877-f2b2-415a-a93c-92caa2ed4071 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1321 microversion: 2.1 time: 0.559505 May 19 06:31:44.656955 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 47/89] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:44 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1321 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:31:44.659387 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c7d54fa5-a4aa-4044-be7a-08f3b8c99df6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1363 microversion: 2.1 time: 0.484646 May 19 06:31:44.673465 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 43/90] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:44 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1363 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:45.194311 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7b134c29-0294-4882-b537-b78b36caa3e0 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:45.200453 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7b134c29-0294-4882-b537-b78b36caa3e0 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:45.233937 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7b134c29-0294-4882-b537-b78b36caa3e0 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:45.240311 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7b134c29-0294-4882-b537-b78b36caa3e0 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:45.244505 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7b134c29-0294-4882-b537-b78b36caa3e0 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:45.245551 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7b134c29-0294-4882-b537-b78b36caa3e0 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:45.683062 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c00ae109-1bc0-4e0e-8245-7ce33c4c82f7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:45.690316 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c00ae109-1bc0-4e0e-8245-7ce33c4c82f7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:45.751772 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c00ae109-1bc0-4e0e-8245-7ce33c4c82f7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:45.752356 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c00ae109-1bc0-4e0e-8245-7ce33c4c82f7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:45.753814 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c00ae109-1bc0-4e0e-8245-7ce33c4c82f7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:45.754581 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c00ae109-1bc0-4e0e-8245-7ce33c4c82f7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:45.888549 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7b134c29-0294-4882-b537-b78b36caa3e0 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:45.926587 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7b134c29-0294-4882-b537-b78b36caa3e0 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf" status: 200 len: 1555 microversion: 2.1 time: 0.741304 May 19 06:31:45.930032 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 48/91] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:45 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf => generated 1555 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:45.946586 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-fbb4f054-f1f2-486d-87dc-2b82e08d24c3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:45.948872 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-fbb4f054-f1f2-486d-87dc-2b82e08d24c3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:45.971326 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fbb4f054-f1f2-486d-87dc-2b82e08d24c3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:45.973133 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fbb4f054-f1f2-486d-87dc-2b82e08d24c3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:45.975637 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fbb4f054-f1f2-486d-87dc-2b82e08d24c3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:45.980275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fbb4f054-f1f2-486d-87dc-2b82e08d24c3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:46.228674 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c00ae109-1bc0-4e0e-8245-7ce33c4c82f7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:46.242313 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c00ae109-1bc0-4e0e-8245-7ce33c4c82f7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1363 microversion: 2.1 time: 0.563687 May 19 06:31:46.243945 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 44/92] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:45 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1363 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:31:46.279945 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-aace7aef-5c60-4107-bce9-e14e172975a9 req-e0d66c79-c50a-4303-90c0-c4133149a5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f4202e4-0d0b-4d78-b9e3-a8e529700d8e", "name": "network-vif-plugged", "status": "completed", "tag": "7b1f2836-944c-46f7-af0c-4d51b0b73e65"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:31:46.293616 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-aace7aef-5c60-4107-bce9-e14e172975a9 req-e0d66c79-c50a-4303-90c0-c4133149a5d5 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:46.294159 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-aace7aef-5c60-4107-bce9-e14e172975a9 req-e0d66c79-c50a-4303-90c0-c4133149a5d5 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:46.311687 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-aace7aef-5c60-4107-bce9-e14e172975a9 req-e0d66c79-c50a-4303-90c0-c4133149a5d5 service nova] Creating event network-vif-plugged:7b1f2836-944c-46f7-af0c-4d51b0b73e65 for instance 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e on hv-cinder-83699 May 19 06:31:46.323954 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-aace7aef-5c60-4107-bce9-e14e172975a9 req-e0d66c79-c50a-4303-90c0-c4133149a5d5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078066 May 19 06:31:46.325393 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 45/93] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:31:46.336599 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-629631f3-4316-41a3-ba9b-2bb2fb3548c6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:46.337383 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-629631f3-4316-41a3-ba9b-2bb2fb3548c6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:46.348405 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-629631f3-4316-41a3-ba9b-2bb2fb3548c6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:46.349699 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-629631f3-4316-41a3-ba9b-2bb2fb3548c6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:46.351701 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-629631f3-4316-41a3-ba9b-2bb2fb3548c6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:46.352502 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-629631f3-4316-41a3-ba9b-2bb2fb3548c6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:46.384923 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-fbb4f054-f1f2-486d-87dc-2b82e08d24c3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:46.418152 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-fbb4f054-f1f2-486d-87dc-2b82e08d24c3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1321 microversion: 2.1 time: 0.482411 May 19 06:31:46.441541 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 49/94] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:45 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1321 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:46.542846 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-629631f3-4316-41a3-ba9b-2bb2fb3548c6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.215703 May 19 06:31:46.543768 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 46/95] 10.222.0.65 () {58 vars in 1274 bytes} [Thu May 19 06:31:46 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf/os-interface => generated 284 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:31:47.275931 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-64f17b01-390e-49d0-95ba-5e5677be6b9f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:47.280400 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-64f17b01-390e-49d0-95ba-5e5677be6b9f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:47.313841 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-64f17b01-390e-49d0-95ba-5e5677be6b9f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:47.317179 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-64f17b01-390e-49d0-95ba-5e5677be6b9f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:47.323543 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-64f17b01-390e-49d0-95ba-5e5677be6b9f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:47.331694 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-64f17b01-390e-49d0-95ba-5e5677be6b9f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:47.448942 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7f29697a-567e-48cc-bc48-f4dbcbf679a7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:47.449755 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7f29697a-567e-48cc-bc48-f4dbcbf679a7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:47.459396 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7f29697a-567e-48cc-bc48-f4dbcbf679a7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:47.460057 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7f29697a-567e-48cc-bc48-f4dbcbf679a7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:47.460903 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7f29697a-567e-48cc-bc48-f4dbcbf679a7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:47.463436 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7f29697a-567e-48cc-bc48-f4dbcbf679a7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:47.887887 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-64f17b01-390e-49d0-95ba-5e5677be6b9f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:47.903988 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-64f17b01-390e-49d0-95ba-5e5677be6b9f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1363 microversion: 2.1 time: 0.637297 May 19 06:31:47.906917 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 50/96] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:47 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1363 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:48.294631 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7f29697a-567e-48cc-bc48-f4dbcbf679a7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:48.313750 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7f29697a-567e-48cc-bc48-f4dbcbf679a7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1321 microversion: 2.1 time: 0.869322 May 19 06:31:48.320907 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 47/97] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:47 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1321 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:48.347609 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-39bd4920-1929-4926-a3fa-57f130b1e911 req-9e6daf31-d718-446e-8ba7-788b161f7bae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab7664a1-4da9-4338-996f-82bf458729ac", "name": "network-vif-plugged", "status": "completed", "tag": "a273e96a-f26e-4d91-b813-288465dd486f"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:31:48.375085 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-39bd4920-1929-4926-a3fa-57f130b1e911 req-9e6daf31-d718-446e-8ba7-788b161f7bae service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:48.375658 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-39bd4920-1929-4926-a3fa-57f130b1e911 req-9e6daf31-d718-446e-8ba7-788b161f7bae service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:48.420848 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-39bd4920-1929-4926-a3fa-57f130b1e911 req-9e6daf31-d718-446e-8ba7-788b161f7bae service nova] Creating event network-vif-plugged:a273e96a-f26e-4d91-b813-288465dd486f for instance ab7664a1-4da9-4338-996f-82bf458729ac on hv-cinder-83699 May 19 06:31:48.443764 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-39bd4920-1929-4926-a3fa-57f130b1e911 req-9e6daf31-d718-446e-8ba7-788b161f7bae service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095976 May 19 06:31:48.444923 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 51/98] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:31:48.927293 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f200e6c3-0eb1-40f4-a47d-907f882bdd8b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:48.928369 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f200e6c3-0eb1-40f4-a47d-907f882bdd8b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:48.960201 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f200e6c3-0eb1-40f4-a47d-907f882bdd8b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:48.961036 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f200e6c3-0eb1-40f4-a47d-907f882bdd8b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:48.962966 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f200e6c3-0eb1-40f4-a47d-907f882bdd8b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:48.964051 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f200e6c3-0eb1-40f4-a47d-907f882bdd8b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:49.345866 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1c6cc158-f759-4f3b-b160-ff013d5aab31 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:49.356225 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1c6cc158-f759-4f3b-b160-ff013d5aab31 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:49.398689 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1c6cc158-f759-4f3b-b160-ff013d5aab31 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:49.401051 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1c6cc158-f759-4f3b-b160-ff013d5aab31 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:49.416446 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1c6cc158-f759-4f3b-b160-ff013d5aab31 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:49.418014 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1c6cc158-f759-4f3b-b160-ff013d5aab31 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:50.070944 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1c6cc158-f759-4f3b-b160-ff013d5aab31 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:50.092888 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1c6cc158-f759-4f3b-b160-ff013d5aab31 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1321 microversion: 2.1 time: 0.761076 May 19 06:31:50.106242 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 52/99] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:49 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1321 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:50.111653 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f200e6c3-0eb1-40f4-a47d-907f882bdd8b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:50.120641 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-12624f34-4b1a-4d0a-83d8-26bd40bf999c tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:50.122202 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-12624f34-4b1a-4d0a-83d8-26bd40bf999c tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:50.133489 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-12624f34-4b1a-4d0a-83d8-26bd40bf999c tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:50.134589 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-12624f34-4b1a-4d0a-83d8-26bd40bf999c tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:50.136520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-12624f34-4b1a-4d0a-83d8-26bd40bf999c tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:50.137185 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-12624f34-4b1a-4d0a-83d8-26bd40bf999c tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:50.162790 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f200e6c3-0eb1-40f4-a47d-907f882bdd8b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1363 microversion: 2.1 time: 1.241005 May 19 06:31:50.178052 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 48/100] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:48 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1363 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:50.226852 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-12624f34-4b1a-4d0a-83d8-26bd40bf999c tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Going to try to terminate instance {{(pid=117712) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 06:31:50.270437 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-ecfe638c-911d-4d21-99c3-d1da1b395e56 req-f6e04626-7d2d-4b20-99df-1d77bd6c0ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27482c04-b2af-4f4a-be37-655969d386cf", "tag": "cb1871e1-4ddc-43af-a6f0-08f3745f2edf"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:31:50.281690 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-ecfe638c-911d-4d21-99c3-d1da1b395e56 req-f6e04626-7d2d-4b20-99df-1d77bd6c0ce7 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:50.282144 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-ecfe638c-911d-4d21-99c3-d1da1b395e56 req-f6e04626-7d2d-4b20-99df-1d77bd6c0ce7 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:50.293947 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:31:50.306435 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-ecfe638c-911d-4d21-99c3-d1da1b395e56 req-f6e04626-7d2d-4b20-99df-1d77bd6c0ce7 service nova] Creating event network-changed:cb1871e1-4ddc-43af-a6f0-08f3745f2edf for instance 27482c04-b2af-4f4a-be37-655969d386cf on hv-cinder-83699 May 19 06:31:50.314094 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-ecfe638c-911d-4d21-99c3-d1da1b395e56 req-f6e04626-7d2d-4b20-99df-1d77bd6c0ce7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047264 May 19 06:31:50.315138 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 49/101] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:31:50.558516 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-12624f34-4b1a-4d0a-83d8-26bd40bf999c tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 204 len: 0 microversion: 2.1 time: 0.449055 May 19 06:31:50.562240 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 53/102] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 06:31:50 2022] DELETE /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 06:31:50.572973 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-356608ef-095a-46c1-8a04-9cfbb3326192 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:50.574488 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-356608ef-095a-46c1-8a04-9cfbb3326192 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:50.594281 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-356608ef-095a-46c1-8a04-9cfbb3326192 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:50.596528 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-356608ef-095a-46c1-8a04-9cfbb3326192 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:50.600378 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-356608ef-095a-46c1-8a04-9cfbb3326192 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:50.601205 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-356608ef-095a-46c1-8a04-9cfbb3326192 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:50.989565 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-356608ef-095a-46c1-8a04-9cfbb3326192 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '184b6909ea6649f3b5eadceef3cca359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d7305d881a4ee29213497d3bab5937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:51.012655 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-356608ef-095a-46c1-8a04-9cfbb3326192 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 200 len: 1554 microversion: 2.1 time: 0.445260 May 19 06:31:51.021606 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 50/103] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:50 2022] GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 1554 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:51.120437 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-096f53cf-58cc-4947-ba79-a347c844e9ca tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:51.122966 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-096f53cf-58cc-4947-ba79-a347c844e9ca tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:51.154050 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-096f53cf-58cc-4947-ba79-a347c844e9ca tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:51.155241 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-096f53cf-58cc-4947-ba79-a347c844e9ca tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:51.156743 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-096f53cf-58cc-4947-ba79-a347c844e9ca tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:51.157571 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-096f53cf-58cc-4947-ba79-a347c844e9ca tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:51.210183 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8494cb15-40bd-4952-91bf-312d6ad9ec22 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:51.213390 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8494cb15-40bd-4952-91bf-312d6ad9ec22 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:51.247910 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8494cb15-40bd-4952-91bf-312d6ad9ec22 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:51.248696 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8494cb15-40bd-4952-91bf-312d6ad9ec22 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:51.266711 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8494cb15-40bd-4952-91bf-312d6ad9ec22 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:51.267610 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8494cb15-40bd-4952-91bf-312d6ad9ec22 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:51.611466 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-8494cb15-40bd-4952-91bf-312d6ad9ec22 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:51.622377 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8494cb15-40bd-4952-91bf-312d6ad9ec22 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1363 microversion: 2.1 time: 0.422767 May 19 06:31:51.629823 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 51/104] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:51 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1363 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:51.635010 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-60c496cb-7fa5-42ba-be8f-1b07180218dc req-7082df48-2979-41e2-abf6-4e18356790f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88cd1ef9-5ec7-42ca-9204-dded848822ae", "name": "network-vif-plugged", "status": "completed", "tag": "06df601d-f75d-4b75-b340-1e3f3982ca58"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:31:51.666397 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-60c496cb-7fa5-42ba-be8f-1b07180218dc req-7082df48-2979-41e2-abf6-4e18356790f9 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:51.667814 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-60c496cb-7fa5-42ba-be8f-1b07180218dc req-7082df48-2979-41e2-abf6-4e18356790f9 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:51.691207 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-60c496cb-7fa5-42ba-be8f-1b07180218dc req-7082df48-2979-41e2-abf6-4e18356790f9 service nova] Creating event network-vif-plugged:06df601d-f75d-4b75-b340-1e3f3982ca58 for instance 88cd1ef9-5ec7-42ca-9204-dded848822ae on hv-cinder-83699 May 19 06:31:51.714747 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-60c496cb-7fa5-42ba-be8f-1b07180218dc req-7082df48-2979-41e2-abf6-4e18356790f9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083215 May 19 06:31:51.715646 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 52/105] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:31:51.872181 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-096f53cf-58cc-4947-ba79-a347c844e9ca tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:51.881320 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-096f53cf-58cc-4947-ba79-a347c844e9ca tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1321 microversion: 2.1 time: 0.772906 May 19 06:31:51.881968 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 54/106] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:51 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1321 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:52.043936 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b029b6c0-68da-4d79-80c8-deed837ebe2b tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:52.044738 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b029b6c0-68da-4d79-80c8-deed837ebe2b tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:52.081652 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b029b6c0-68da-4d79-80c8-deed837ebe2b tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:52.086456 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b029b6c0-68da-4d79-80c8-deed837ebe2b tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:52.087798 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b029b6c0-68da-4d79-80c8-deed837ebe2b tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:52.088646 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b029b6c0-68da-4d79-80c8-deed837ebe2b tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:52.560951 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b029b6c0-68da-4d79-80c8-deed837ebe2b tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '184b6909ea6649f3b5eadceef3cca359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d7305d881a4ee29213497d3bab5937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:52.577095 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b029b6c0-68da-4d79-80c8-deed837ebe2b tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 200 len: 1554 microversion: 2.1 time: 0.538580 May 19 06:31:52.578509 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 53/107] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:52 2022] GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 1554 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:52.658152 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-fcf7570b-82c7-459a-bed0-bbe990012b96 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:52.659484 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-fcf7570b-82c7-459a-bed0-bbe990012b96 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:52.704275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fcf7570b-82c7-459a-bed0-bbe990012b96 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:52.705014 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fcf7570b-82c7-459a-bed0-bbe990012b96 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:52.706364 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fcf7570b-82c7-459a-bed0-bbe990012b96 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:52.710915 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fcf7570b-82c7-459a-bed0-bbe990012b96 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:52.899106 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-20540b64-ce2a-4d68-b0ab-183cad5d1e02 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:52.900031 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-20540b64-ce2a-4d68-b0ab-183cad5d1e02 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:52.916221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-20540b64-ce2a-4d68-b0ab-183cad5d1e02 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:52.917748 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-20540b64-ce2a-4d68-b0ab-183cad5d1e02 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:52.919533 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-20540b64-ce2a-4d68-b0ab-183cad5d1e02 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:52.922876 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-20540b64-ce2a-4d68-b0ab-183cad5d1e02 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:53.300581 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-fcf7570b-82c7-459a-bed0-bbe990012b96 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:53.316315 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-fcf7570b-82c7-459a-bed0-bbe990012b96 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1550 microversion: 2.1 time: 0.671939 May 19 06:31:53.325084 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 55/108] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:52 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1550 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:53.338305 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e831e157-c947-4b7f-a217-4ea8883632aa tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:53.341422 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e831e157-c947-4b7f-a217-4ea8883632aa tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:53.364974 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e831e157-c947-4b7f-a217-4ea8883632aa tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:53.369995 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e831e157-c947-4b7f-a217-4ea8883632aa tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:53.374571 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e831e157-c947-4b7f-a217-4ea8883632aa tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:53.379285 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e831e157-c947-4b7f-a217-4ea8883632aa tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:53.684622 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-20540b64-ce2a-4d68-b0ab-183cad5d1e02 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:53.699325 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-20540b64-ce2a-4d68-b0ab-183cad5d1e02 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1321 microversion: 2.1 time: 0.803796 May 19 06:31:53.700110 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 54/109] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:52 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1321 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:31:53.705858 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-958be334-938b-48b7-8d2c-179cb7e1bf57 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:53.711942 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-958be334-938b-48b7-8d2c-179cb7e1bf57 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:53.731788 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-958be334-938b-48b7-8d2c-179cb7e1bf57 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:53.732332 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-958be334-938b-48b7-8d2c-179cb7e1bf57 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:53.733560 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-958be334-938b-48b7-8d2c-179cb7e1bf57 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:53.734214 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-958be334-938b-48b7-8d2c-179cb7e1bf57 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:53.948383 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-958be334-938b-48b7-8d2c-179cb7e1bf57 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '184b6909ea6649f3b5eadceef3cca359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d7305d881a4ee29213497d3bab5937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:53.966325 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-958be334-938b-48b7-8d2c-179cb7e1bf57 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 200 len: 1554 microversion: 2.1 time: 0.264661 May 19 06:31:53.967394 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 55/110] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:53 2022] GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 1554 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:54.116545 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e831e157-c947-4b7f-a217-4ea8883632aa tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.781387 May 19 06:31:54.122294 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 56/111] 10.222.0.65 () {58 vars in 1274 bytes} [Thu May 19 06:31:53 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac/os-interface => generated 285 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:31:54.723573 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-bbedc5a8-7a41-45c1-8dcc-9651afbf52b9 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:54.732694 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-bbedc5a8-7a41-45c1-8dcc-9651afbf52b9 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:54.778060 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bbedc5a8-7a41-45c1-8dcc-9651afbf52b9 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:54.782551 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bbedc5a8-7a41-45c1-8dcc-9651afbf52b9 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:54.784156 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bbedc5a8-7a41-45c1-8dcc-9651afbf52b9 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:54.784942 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bbedc5a8-7a41-45c1-8dcc-9651afbf52b9 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:54.875769 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-07fa060f-c6a2-487b-bca8-0154ba770685 req-affdd164-f2b2-4d3c-91e9-b87da4b2f337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bfcd957-5a5f-4c7b-81ea-61c732fc3354", "name": "network-vif-deleted", "tag": "946cfd64-c054-41e4-aadd-9b6bf0f436f8"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:31:54.907458 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-07fa060f-c6a2-487b-bca8-0154ba770685 req-affdd164-f2b2-4d3c-91e9-b87da4b2f337 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:54.908771 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-07fa060f-c6a2-487b-bca8-0154ba770685 req-affdd164-f2b2-4d3c-91e9-b87da4b2f337 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:54.942795 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-07fa060f-c6a2-487b-bca8-0154ba770685 req-affdd164-f2b2-4d3c-91e9-b87da4b2f337 service nova] Creating event network-vif-deleted:946cfd64-c054-41e4-aadd-9b6bf0f436f8 for instance 7bfcd957-5a5f-4c7b-81ea-61c732fc3354 on hv-cinder-83699 May 19 06:31:54.957539 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-07fa060f-c6a2-487b-bca8-0154ba770685 req-affdd164-f2b2-4d3c-91e9-b87da4b2f337 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085092 May 19 06:31:54.967786 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 57/112] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:31:54.987907 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a9a5075a-f84f-4cf2-9b31-64f9e2dc3108 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:54.989028 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a9a5075a-f84f-4cf2-9b31-64f9e2dc3108 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:55.002026 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a9a5075a-f84f-4cf2-9b31-64f9e2dc3108 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:55.006152 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a9a5075a-f84f-4cf2-9b31-64f9e2dc3108 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:55.007391 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a9a5075a-f84f-4cf2-9b31-64f9e2dc3108 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:55.010546 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a9a5075a-f84f-4cf2-9b31-64f9e2dc3108 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:55.684875 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a9a5075a-f84f-4cf2-9b31-64f9e2dc3108 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '184b6909ea6649f3b5eadceef3cca359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d7305d881a4ee29213497d3bab5937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:55.698654 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a9a5075a-f84f-4cf2-9b31-64f9e2dc3108 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 200 len: 1512 microversion: 2.1 time: 0.714569 May 19 06:31:55.699196 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 58/113] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:54 2022] GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 1512 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:55.837709 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-bbedc5a8-7a41-45c1-8dcc-9651afbf52b9 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:55.866528 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-bbedc5a8-7a41-45c1-8dcc-9651afbf52b9 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1321 microversion: 2.1 time: 1.150866 May 19 06:31:55.890738 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 56/114] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:54 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1321 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:56.457164 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-07c3fdb1-b975-48df-a24d-5daf4d70f7e2 req-a350d0fd-c10c-4bb9-845b-1549264136c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab7664a1-4da9-4338-996f-82bf458729ac", "tag": "a273e96a-f26e-4d91-b813-288465dd486f"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:31:56.510381 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-07c3fdb1-b975-48df-a24d-5daf4d70f7e2 req-a350d0fd-c10c-4bb9-845b-1549264136c3 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:56.511776 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-07c3fdb1-b975-48df-a24d-5daf4d70f7e2 req-a350d0fd-c10c-4bb9-845b-1549264136c3 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:56.559425 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-07c3fdb1-b975-48df-a24d-5daf4d70f7e2 req-a350d0fd-c10c-4bb9-845b-1549264136c3 service nova] Creating event network-changed:a273e96a-f26e-4d91-b813-288465dd486f for instance ab7664a1-4da9-4338-996f-82bf458729ac on hv-cinder-83699 May 19 06:31:56.567119 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-07c3fdb1-b975-48df-a24d-5daf4d70f7e2 req-a350d0fd-c10c-4bb9-845b-1549264136c3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121675 May 19 06:31:56.573488 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 59/115] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:31:56.724856 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-929a38a2-1c0f-4870-b4cd-902a97e85735 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:56.726741 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-929a38a2-1c0f-4870-b4cd-902a97e85735 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:56.758245 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-929a38a2-1c0f-4870-b4cd-902a97e85735 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:56.759024 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-929a38a2-1c0f-4870-b4cd-902a97e85735 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:56.760129 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-929a38a2-1c0f-4870-b4cd-902a97e85735 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:56.761132 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-929a38a2-1c0f-4870-b4cd-902a97e85735 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:56.900240 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-bbee8320-149a-426f-9881-570efeb514e1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:56.901105 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-bbee8320-149a-426f-9881-570efeb514e1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:56.915925 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bbee8320-149a-426f-9881-570efeb514e1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:56.917867 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-929a38a2-1c0f-4870-b4cd-902a97e85735 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:56.918355 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-929a38a2-1c0f-4870-b4cd-902a97e85735 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:56.918784 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-929a38a2-1c0f-4870-b4cd-902a97e85735 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lazy-loading 'fault' on Instance uuid 7bfcd957-5a5f-4c7b-81ea-61c732fc3354 {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:31:56.919566 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bbee8320-149a-426f-9881-570efeb514e1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:56.923371 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bbee8320-149a-426f-9881-570efeb514e1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:56.927752 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bbee8320-149a-426f-9881-570efeb514e1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:56.942069 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:31:57.038257 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-929a38a2-1c0f-4870-b4cd-902a97e85735 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '184b6909ea6649f3b5eadceef3cca359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d7305d881a4ee29213497d3bab5937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:57.047385 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-929a38a2-1c0f-4870-b4cd-902a97e85735 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 200 len: 1305 microversion: 2.1 time: 0.332344 May 19 06:31:57.047944 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 57/116] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:56 2022] GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 1305 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:57.464408 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-bbee8320-149a-426f-9881-570efeb514e1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:57.487083 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-bbee8320-149a-426f-9881-570efeb514e1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1514 microversion: 2.1 time: 0.592347 May 19 06:31:57.488028 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 60/117] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:56 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1514 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:57.523531 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-41ddb76b-8279-419b-82be-5b310d5fb9f1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:31:57.525221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-41ddb76b-8279-419b-82be-5b310d5fb9f1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:57.545188 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-41ddb76b-8279-419b-82be-5b310d5fb9f1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:57.546140 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-41ddb76b-8279-419b-82be-5b310d5fb9f1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:57.546969 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-41ddb76b-8279-419b-82be-5b310d5fb9f1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:57.547626 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-41ddb76b-8279-419b-82be-5b310d5fb9f1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:57.636919 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-41ddb76b-8279-419b-82be-5b310d5fb9f1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lazy-loading 'flavor' on Instance uuid 88cd1ef9-5ec7-42ca-9204-dded848822ae {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:31:58.041750 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-41ddb76b-8279-419b-82be-5b310d5fb9f1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "POST /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae/action" status: 200 len: 32 microversion: 2.1 time: 0.522554 May 19 06:31:58.046463 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 58/118] 10.222.0.65 () {60 vars in 1277 bytes} [Thu May 19 06:31:57 2022] POST /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae/action => generated 32 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 06:31:58.053904 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c1851370-55f0-4a38-a761-383e4cdc08f6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:58.054757 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c1851370-55f0-4a38-a761-383e4cdc08f6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:58.065269 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6ffdb063-08f3-421f-95dd-f7b85d231bfb tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:58.066541 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6ffdb063-08f3-421f-95dd-f7b85d231bfb tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:58.071248 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c1851370-55f0-4a38-a761-383e4cdc08f6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:58.073602 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c1851370-55f0-4a38-a761-383e4cdc08f6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:58.074640 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c1851370-55f0-4a38-a761-383e4cdc08f6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:58.076508 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c1851370-55f0-4a38-a761-383e4cdc08f6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:58.084678 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6ffdb063-08f3-421f-95dd-f7b85d231bfb tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:58.085135 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6ffdb063-08f3-421f-95dd-f7b85d231bfb tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:58.085960 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6ffdb063-08f3-421f-95dd-f7b85d231bfb tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:58.086397 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6ffdb063-08f3-421f-95dd-f7b85d231bfb tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:58.344372 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-6ffdb063-08f3-421f-95dd-f7b85d231bfb tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] HTTP exception thrown: Instance 7bfcd957-5a5f-4c7b-81ea-61c732fc3354 could not be found. May 19 06:31:58.349661 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6ffdb063-08f3-421f-95dd-f7b85d231bfb tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Request method failure captured: May 19 06:31:58.349661 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 HTTP/1.1 May 19 06:31:58.349661 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:31:58.349661 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:31:58.349661 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:31:58.349661 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 0 May 19 06:31:58.349661 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:31:58.349661 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:31:58.349661 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:31:58.349661 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:31:58.349661 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheQM4LhE9_sPpk0DVpLiD_hDjmHifXb6AND0ugr6OcJIFH8zOSHOirYuXsIT6fBuKyBfttGgXXkoROe2kuTOBrCxhe6992XA01XOCWsyze7Nrx53BZ5mNeXbexnvSrO-M5VaxyHK80-AArs69I78Gc1UU9kmXzRCEuAtPYxe4Gl_mmo May 19 06:31:58.349661 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:31:58.349661 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:31:58.349661 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:31:58.349661 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:31:58.349661 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:31:58.349661 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:31:58.349661 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: d2d7305d881a4ee29213497d3bab5937 May 19 06:31:58.349661 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-DeleteServersTestJSON-1350798229 May 19 06:31:58.349661 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:31:58.349661 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:31:58.351302 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2d7305d881a4ee29213497d3bab5937"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d2d7305d881a4ee29213497d3bab5937"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2d7305d881a4ee29213497d3bab5937"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d2d7305d881a4ee29213497d3bab5937", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:31:58.351302 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-DeleteServersTestJSON-1350798229 May 19 06:31:58.351302 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: d2d7305d881a4ee29213497d3bab5937 May 19 06:31:58.351302 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-DeleteServersTestJSON-1350798229 May 19 06:31:58.351302 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-DeleteServersTestJSON-1350798229-project May 19 06:31:58.351302 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:31:58.351302 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:31:58.351302 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: 184b6909ea6649f3b5eadceef3cca359 May 19 06:31:58.351302 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-DeleteServersTestJSON-1350798229-project May 19 06:31:58.351302 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: > May 19 06:31:58.351302 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Instance 7bfcd957-5a5f-4c7b-81ea-61c732fc3354 could not be found. May 19 06:31:58.351302 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'id': '7bfcd957-5a5f-4c7b-81ea-61c732fc3354'} May 19 06:31:58.352253 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:31:58.352253 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:31:58.352253 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:31:58.352253 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:31:58.352253 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:31:58.352253 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:31:58.352253 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:31:58.352253 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:31:58.352253 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:31:58.352253 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:31:58.352253 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bfcd957-5a5f-4c7b-81ea-61c732fc3354 could not be found. May 19 06:31:58.352253 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:31:58.352253 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:31:58.352253 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:31:58.352253 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:31:58.352253 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:31:58.352253 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:31:58.352253 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:31:58.352253 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:31:58.352253 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:31:58.353806 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:31:58.353806 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:31:58.353806 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:31:58.353806 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:31:58.353806 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:31:58.353806 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:31:58.353806 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:31:58.353806 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bfcd957-5a5f-4c7b-81ea-61c732fc3354 could not be found. May 19 06:31:58.353806 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:31:58.353806 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:31:58.353806 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:31:58.353806 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:31:58.353806 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:31:58.353806 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:31:58.353806 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:31:58.353806 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:31:58.353806 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bfcd957-5a5f-4c7b-81ea-61c732fc3354 could not be found. May 19 06:31:58.353806 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:31:58.356843 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6ffdb063-08f3-421f-95dd-f7b85d231bfb tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Returning 404 to user: Instance 7bfcd957-5a5f-4c7b-81ea-61c732fc3354 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:31:58.358177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6ffdb063-08f3-421f-95dd-f7b85d231bfb tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 404 len: 111 microversion: 2.1 time: 0.297034 May 19 06:31:58.359810 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 59/119] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:58 2022] GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 111 bytes in 299 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:31:58.491916 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c1851370-55f0-4a38-a761-383e4cdc08f6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:58.507376 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c1851370-55f0-4a38-a761-383e4cdc08f6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.458049 May 19 06:31:58.508373 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 61/120] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:58 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:31:58.653271 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ca2ed3ab-1eb7-42bc-a202-f704a956671b tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:58.655034 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ca2ed3ab-1eb7-42bc-a202-f704a956671b tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:58.663356 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ca2ed3ab-1eb7-42bc-a202-f704a956671b tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:58.664569 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ca2ed3ab-1eb7-42bc-a202-f704a956671b tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:58.665657 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ca2ed3ab-1eb7-42bc-a202-f704a956671b tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:58.666425 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ca2ed3ab-1eb7-42bc-a202-f704a956671b tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:58.703043 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-ca2ed3ab-1eb7-42bc-a202-f704a956671b tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] HTTP exception thrown: Instance 7bfcd957-5a5f-4c7b-81ea-61c732fc3354 could not be found. May 19 06:31:58.706518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ca2ed3ab-1eb7-42bc-a202-f704a956671b tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Request method failure captured: May 19 06:31:58.706518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354/os-volume_attachments HTTP/1.1 May 19 06:31:58.706518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:31:58.706518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:31:58.706518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:31:58.706518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 0 May 19 06:31:58.706518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:31:58.706518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:31:58.706518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:31:58.706518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:31:58.706518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheQM4LhE9_sPpk0DVpLiD_hDjmHifXb6AND0ugr6OcJIFH8zOSHOirYuXsIT6fBuKyBfttGgXXkoROe2kuTOBrCxhe6992XA01XOCWsyze7Nrx53BZ5mNeXbexnvSrO-M5VaxyHK80-AArs69I78Gc1UU9kmXzRCEuAtPYxe4Gl_mmo May 19 06:31:58.706518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:31:58.706518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:31:58.706518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:31:58.706518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:31:58.706518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:31:58.706518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:31:58.706518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: d2d7305d881a4ee29213497d3bab5937 May 19 06:31:58.706518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-DeleteServersTestJSON-1350798229 May 19 06:31:58.706518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:31:58.706518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:31:58.707920 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2d7305d881a4ee29213497d3bab5937"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d2d7305d881a4ee29213497d3bab5937"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2d7305d881a4ee29213497d3bab5937"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d2d7305d881a4ee29213497d3bab5937", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:31:58.707920 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-DeleteServersTestJSON-1350798229 May 19 06:31:58.707920 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: d2d7305d881a4ee29213497d3bab5937 May 19 06:31:58.707920 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-DeleteServersTestJSON-1350798229 May 19 06:31:58.707920 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-DeleteServersTestJSON-1350798229-project May 19 06:31:58.707920 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:31:58.707920 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:31:58.707920 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: 184b6909ea6649f3b5eadceef3cca359 May 19 06:31:58.707920 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-DeleteServersTestJSON-1350798229-project May 19 06:31:58.707920 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: > May 19 06:31:58.707920 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Instance 7bfcd957-5a5f-4c7b-81ea-61c732fc3354 could not be found. May 19 06:31:58.707920 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'server_id': '7bfcd957-5a5f-4c7b-81ea-61c732fc3354'} May 19 06:31:58.708857 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:31:58.708857 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:31:58.708857 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:31:58.708857 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:31:58.708857 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:31:58.708857 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:31:58.708857 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:31:58.708857 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:31:58.708857 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:31:58.708857 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:31:58.708857 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bfcd957-5a5f-4c7b-81ea-61c732fc3354 could not be found. May 19 06:31:58.708857 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:31:58.708857 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:31:58.708857 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:31:58.708857 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:31:58.708857 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:31:58.708857 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:31:58.708857 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:31:58.708857 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:31:58.708857 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:31:58.710034 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:31:58.710034 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 06:31:58.710034 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 06:31:58.710034 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 06:31:58.710034 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 06:31:58.710034 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 19 06:31:58.710034 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 19 06:31:58.710034 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:31:58.710034 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:31:58.710034 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bfcd957-5a5f-4c7b-81ea-61c732fc3354 could not be found. May 19 06:31:58.710034 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:31:58.710034 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:31:58.710034 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:31:58.710034 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:31:58.710034 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:31:58.710034 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:31:58.710034 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:31:58.710034 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:31:58.710034 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bfcd957-5a5f-4c7b-81ea-61c732fc3354 could not be found. May 19 06:31:58.710034 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:31:58.711167 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ca2ed3ab-1eb7-42bc-a202-f704a956671b tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Returning 404 to user: Instance 7bfcd957-5a5f-4c7b-81ea-61c732fc3354 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:31:58.711167 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ca2ed3ab-1eb7-42bc-a202-f704a956671b tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.061696 May 19 06:31:58.716606 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 60/121] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 06:31:58 2022] GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354/os-volume_attachments => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:31:59.531203 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f81e8fca-3825-4433-8d6d-525e137683c5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:31:59.532292 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f81e8fca-3825-4433-8d6d-525e137683c5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:31:59.544861 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f81e8fca-3825-4433-8d6d-525e137683c5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:59.546638 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f81e8fca-3825-4433-8d6d-525e137683c5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:59.548971 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f81e8fca-3825-4433-8d6d-525e137683c5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:31:59.550231 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f81e8fca-3825-4433-8d6d-525e137683c5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:31:59.811650 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f81e8fca-3825-4433-8d6d-525e137683c5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:31:59.832399 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f81e8fca-3825-4433-8d6d-525e137683c5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.309154 May 19 06:31:59.836053 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 62/122] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:31:59 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:00.347568 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e29d257c-561d-4452-8e58-6d5cc70cfa3f tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:00.348196 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e29d257c-561d-4452-8e58-6d5cc70cfa3f tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:00.364759 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e29d257c-561d-4452-8e58-6d5cc70cfa3f tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:00.365570 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e29d257c-561d-4452-8e58-6d5cc70cfa3f tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:00.366883 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e29d257c-561d-4452-8e58-6d5cc70cfa3f tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:00.369868 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e29d257c-561d-4452-8e58-6d5cc70cfa3f tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:00.420762 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-e29d257c-561d-4452-8e58-6d5cc70cfa3f tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] HTTP exception thrown: Instance 7bfcd957-5a5f-4c7b-81ea-61c732fc3354 could not be found. May 19 06:32:00.423929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e29d257c-561d-4452-8e58-6d5cc70cfa3f tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Request method failure captured: May 19 06:32:00.423929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: DELETE /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 HTTP/1.1 May 19 06:32:00.423929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:32:00.423929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:32:00.423929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:32:00.423929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 0 May 19 06:32:00.423929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:32:00.423929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:32:00.423929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:32:00.423929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:32:00.423929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheQM4LhE9_sPpk0DVpLiD_hDjmHifXb6AND0ugr6OcJIFH8zOSHOirYuXsIT6fBuKyBfttGgXXkoROe2kuTOBrCxhe6992XA01XOCWsyze7Nrx53BZ5mNeXbexnvSrO-M5VaxyHK80-AArs69I78Gc1UU9kmXzRCEuAtPYxe4Gl_mmo May 19 06:32:00.423929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:32:00.423929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:32:00.423929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:32:00.423929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:32:00.423929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:32:00.423929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:32:00.423929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: d2d7305d881a4ee29213497d3bab5937 May 19 06:32:00.423929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-DeleteServersTestJSON-1350798229 May 19 06:32:00.423929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:32:00.423929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:32:00.425205 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2d7305d881a4ee29213497d3bab5937"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d2d7305d881a4ee29213497d3bab5937"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2d7305d881a4ee29213497d3bab5937"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d2d7305d881a4ee29213497d3bab5937", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:32:00.425205 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-DeleteServersTestJSON-1350798229 May 19 06:32:00.425205 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: d2d7305d881a4ee29213497d3bab5937 May 19 06:32:00.425205 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-DeleteServersTestJSON-1350798229 May 19 06:32:00.425205 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-DeleteServersTestJSON-1350798229-project May 19 06:32:00.425205 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:32:00.425205 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:32:00.425205 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: 184b6909ea6649f3b5eadceef3cca359 May 19 06:32:00.425205 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-DeleteServersTestJSON-1350798229-project May 19 06:32:00.425205 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: > May 19 06:32:00.425205 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Instance 7bfcd957-5a5f-4c7b-81ea-61c732fc3354 could not be found. May 19 06:32:00.425205 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'id': '7bfcd957-5a5f-4c7b-81ea-61c732fc3354'} May 19 06:32:00.425967 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:32:00.425967 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:32:00.425967 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:32:00.425967 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:32:00.425967 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:32:00.425967 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:32:00.425967 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:32:00.425967 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:32:00.425967 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:32:00.425967 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:32:00.425967 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bfcd957-5a5f-4c7b-81ea-61c732fc3354 could not be found. May 19 06:32:00.425967 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:32:00.425967 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:32:00.425967 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:32:00.425967 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:32:00.425967 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:32:00.425967 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:32:00.425967 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:32:00.425967 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:32:00.425967 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:32:00.427177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:32:00.427177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 06:32:00.427177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 06:32:00.427177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 06:32:00.427177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 06:32:00.427177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:32:00.427177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:32:00.427177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:32:00.427177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:32:00.427177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bfcd957-5a5f-4c7b-81ea-61c732fc3354 could not be found. May 19 06:32:00.427177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:32:00.427177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:32:00.427177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:32:00.427177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:32:00.427177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:32:00.427177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:32:00.427177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:32:00.427177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:32:00.427177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bfcd957-5a5f-4c7b-81ea-61c732fc3354 could not be found. May 19 06:32:00.427177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:32:00.428407 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e29d257c-561d-4452-8e58-6d5cc70cfa3f tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Returning 404 to user: Instance 7bfcd957-5a5f-4c7b-81ea-61c732fc3354 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:32:00.428407 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e29d257c-561d-4452-8e58-6d5cc70cfa3f tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 404 len: 111 microversion: 2.1 time: 0.083401 May 19 06:32:00.428407 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 61/123] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 06:32:00 2022] DELETE /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 06:32:00.443174 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-85e91a53-4bb1-47e3-a898-8714237badf8 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:00.443174 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-85e91a53-4bb1-47e3-a898-8714237badf8 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] [instance: 7bfcd957-5a5f-4c7b-81ea-61c732fc3354] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:00.454189 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-85e91a53-4bb1-47e3-a898-8714237badf8 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:00.454962 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-85e91a53-4bb1-47e3-a898-8714237badf8 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:00.456373 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-85e91a53-4bb1-47e3-a898-8714237badf8 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:00.457146 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-85e91a53-4bb1-47e3-a898-8714237badf8 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:00.487777 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-85e91a53-4bb1-47e3-a898-8714237badf8 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] HTTP exception thrown: Instance 7bfcd957-5a5f-4c7b-81ea-61c732fc3354 could not be found. May 19 06:32:00.497596 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-85e91a53-4bb1-47e3-a898-8714237badf8 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Request method failure captured: May 19 06:32:00.497596 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 HTTP/1.1 May 19 06:32:00.497596 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept: application/json May 19 06:32:00.497596 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity May 19 06:32:00.497596 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Connection: close May 19 06:32:00.497596 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Length: 0 May 19 06:32:00.497596 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Type: application/json May 19 06:32:00.497596 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Host: 10.222.0.65 May 19 06:32:00.497596 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None May 19 06:32:00.497596 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 May 19 06:32:00.497596 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiheQM4LhE9_sPpk0DVpLiD_hDjmHifXb6AND0ugr6OcJIFH8zOSHOirYuXsIT6fBuKyBfttGgXXkoROe2kuTOBrCxhe6992XA01XOCWsyze7Nrx53BZ5mNeXbexnvSrO-M5VaxyHK80-AArs69I78Gc1UU9kmXzRCEuAtPYxe4Gl_mmo May 19 06:32:00.497596 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Id: None May 19 06:32:00.497596 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Name: None May 19 06:32:00.497596 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed May 19 06:32:00.497596 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True May 19 06:32:00.497596 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default May 19 06:32:00.497596 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default May 19 06:32:00.497596 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Id: d2d7305d881a4ee29213497d3bab5937 May 19 06:32:00.497596 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-DeleteServersTestJSON-1350798229 May 19 06:32:00.497596 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Role: reader,member May 19 06:32:00.497596 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Roles: reader,member May 19 06:32:00.498978 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2d7305d881a4ee29213497d3bab5937"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d2d7305d881a4ee29213497d3bab5937"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2d7305d881a4ee29213497d3bab5937"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d2d7305d881a4ee29213497d3bab5937", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:32:00.498978 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-DeleteServersTestJSON-1350798229 May 19 06:32:00.498978 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Id: d2d7305d881a4ee29213497d3bab5937 May 19 06:32:00.498978 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-DeleteServersTestJSON-1350798229 May 19 06:32:00.498978 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User: tempest-DeleteServersTestJSON-1350798229-project May 19 06:32:00.498978 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default May 19 06:32:00.498978 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default May 19 06:32:00.498978 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Id: 184b6909ea6649f3b5eadceef3cca359 May 19 06:32:00.498978 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-DeleteServersTestJSON-1350798229-project May 19 06:32:00.498978 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: method: > May 19 06:32:00.498978 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: exception: Instance 7bfcd957-5a5f-4c7b-81ea-61c732fc3354 could not be found. May 19 06:32:00.498978 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: action_args: {'id': '7bfcd957-5a5f-4c7b-81ea-61c732fc3354'} May 19 06:32:00.499948 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:32:00.499948 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:32:00.499948 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:32:00.499948 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:32:00.499948 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:32:00.499948 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:32:00.499948 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:32:00.499948 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:32:00.499948 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:32:00.499948 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:32:00.499948 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bfcd957-5a5f-4c7b-81ea-61c732fc3354 could not be found. May 19 06:32:00.499948 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:32:00.499948 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:32:00.499948 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:32:00.499948 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:32:00.499948 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:32:00.499948 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:32:00.499948 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:32:00.499948 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:32:00.499948 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:32:00.501275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:32:00.501275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:32:00.501275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:32:00.501275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:32:00.501275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:32:00.501275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:32:00.501275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:32:00.501275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bfcd957-5a5f-4c7b-81ea-61c732fc3354 could not be found. May 19 06:32:00.501275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:32:00.501275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:32:00.501275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:32:00.501275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:32:00.501275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:32:00.501275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:32:00.501275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:32:00.501275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:32:00.501275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bfcd957-5a5f-4c7b-81ea-61c732fc3354 could not be found. May 19 06:32:00.501275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:32:00.502624 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-85e91a53-4bb1-47e3-a898-8714237badf8 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] Returning 404 to user: Instance 7bfcd957-5a5f-4c7b-81ea-61c732fc3354 could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:32:00.502624 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-85e91a53-4bb1-47e3-a898-8714237badf8 tempest-DeleteServersTestJSON-1350798229 tempest-DeleteServersTestJSON-1350798229-project] 10.222.0.65 "GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354" status: 404 len: 111 microversion: 2.1 time: 0.066744 May 19 06:32:00.506824 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 63/124] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:00 2022] GET /compute/v2.1/servers/7bfcd957-5a5f-4c7b-81ea-61c732fc3354 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:32:00.873610 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-fe34b7f1-eaf1-4ed1-9b97-9cf76f396c24 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:00.873610 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-fe34b7f1-eaf1-4ed1-9b97-9cf76f396c24 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:00.882116 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fe34b7f1-eaf1-4ed1-9b97-9cf76f396c24 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:00.882956 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fe34b7f1-eaf1-4ed1-9b97-9cf76f396c24 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:00.884026 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fe34b7f1-eaf1-4ed1-9b97-9cf76f396c24 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:00.884730 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fe34b7f1-eaf1-4ed1-9b97-9cf76f396c24 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:01.258522 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-fe34b7f1-eaf1-4ed1-9b97-9cf76f396c24 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:01.280364 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-fe34b7f1-eaf1-4ed1-9b97-9cf76f396c24 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.415794 May 19 06:32:01.282167 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 62/125] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:00 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:02.331808 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-82219d33-2032-400c-b9b0-aefe9bf96ea8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:02.341214 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-82219d33-2032-400c-b9b0-aefe9bf96ea8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:02.358921 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-82219d33-2032-400c-b9b0-aefe9bf96ea8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:02.359526 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-82219d33-2032-400c-b9b0-aefe9bf96ea8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:02.361701 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-82219d33-2032-400c-b9b0-aefe9bf96ea8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:02.365000 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-82219d33-2032-400c-b9b0-aefe9bf96ea8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:02.788785 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-82219d33-2032-400c-b9b0-aefe9bf96ea8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:02.799815 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-82219d33-2032-400c-b9b0-aefe9bf96ea8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.501276 May 19 06:32:02.813029 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 64/126] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:02 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:03.823128 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f22c56c2-71aa-44a9-b05f-48034df493cf tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:03.823765 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f22c56c2-71aa-44a9-b05f-48034df493cf tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:03.834339 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f22c56c2-71aa-44a9-b05f-48034df493cf tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:03.834796 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f22c56c2-71aa-44a9-b05f-48034df493cf tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:03.837863 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f22c56c2-71aa-44a9-b05f-48034df493cf tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:03.838319 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f22c56c2-71aa-44a9-b05f-48034df493cf tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:04.074998 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f22c56c2-71aa-44a9-b05f-48034df493cf tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:04.086279 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f22c56c2-71aa-44a9-b05f-48034df493cf tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.269493 May 19 06:32:04.087375 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 63/127] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:03 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:05.124883 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-761424d6-9e7b-4046-aed4-35a1e82b329a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:05.126436 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-761424d6-9e7b-4046-aed4-35a1e82b329a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:05.146386 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-761424d6-9e7b-4046-aed4-35a1e82b329a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:05.148078 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-761424d6-9e7b-4046-aed4-35a1e82b329a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:05.151834 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-761424d6-9e7b-4046-aed4-35a1e82b329a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:05.152762 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-761424d6-9e7b-4046-aed4-35a1e82b329a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:05.494653 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-761424d6-9e7b-4046-aed4-35a1e82b329a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:05.527570 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-761424d6-9e7b-4046-aed4-35a1e82b329a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.415026 May 19 06:32:05.542731 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 65/128] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:05 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:06.556976 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-2585d7ee-77b6-4db2-b942-08d040fe0ccc tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:06.559204 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-2585d7ee-77b6-4db2-b942-08d040fe0ccc tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:06.575722 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2585d7ee-77b6-4db2-b942-08d040fe0ccc tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:06.577756 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2585d7ee-77b6-4db2-b942-08d040fe0ccc tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:06.579619 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2585d7ee-77b6-4db2-b942-08d040fe0ccc tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:06.581375 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2585d7ee-77b6-4db2-b942-08d040fe0ccc tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:06.960800 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2585d7ee-77b6-4db2-b942-08d040fe0ccc tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:06.985597 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-2585d7ee-77b6-4db2-b942-08d040fe0ccc tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.440664 May 19 06:32:06.986627 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 64/129] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:06 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:07.510886 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-5611a9e8-bf31-4a5a-811b-bdd34b5fd076 tempest-VolumesTestJSON-1801025123 tempest-VolumesTestJSON-1801025123-project] Calling method '.version_select at 0x7f9aeaf8fd30>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:07.574494 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-5611a9e8-bf31-4a5a-811b-bdd34b5fd076 tempest-VolumesTestJSON-1801025123 tempest-VolumesTestJSON-1801025123-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/0d70ac70-eac6-4f9d-a14d-246a97871e80" status: 200 len: 351 microversion: 2.1 time: 0.068452 May 19 06:32:07.575267 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 66/130] 10.222.0.65 () {58 vars in 1244 bytes} [Thu May 19 06:32:07 2022] GET /compute/v2.1/os-volumes/0d70ac70-eac6-4f9d-a14d-246a97871e80 => generated 351 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:32:08.007098 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5ae2726a-ed10-40c5-a350-ee4424fc1dd1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:08.009268 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5ae2726a-ed10-40c5-a350-ee4424fc1dd1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:08.021585 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=62 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:32:08.025940 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5ae2726a-ed10-40c5-a350-ee4424fc1dd1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:08.031518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5ae2726a-ed10-40c5-a350-ee4424fc1dd1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:08.033035 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5ae2726a-ed10-40c5-a350-ee4424fc1dd1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:08.033700 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5ae2726a-ed10-40c5-a350-ee4424fc1dd1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:08.311565 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5ae2726a-ed10-40c5-a350-ee4424fc1dd1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:08.338532 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5ae2726a-ed10-40c5-a350-ee4424fc1dd1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.336580 May 19 06:32:08.338685 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 65/131] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:07 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:32:09.176883 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6a6193e1-e307-4b18-9283-60a04ecda4fb tempest-VolumesTestJSON-1801025123 tempest-VolumesTestJSON-1801025123-project] Calling method '.version_select at 0x7f9aeafe2ee0>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:09.244122 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6a6193e1-e307-4b18-9283-60a04ecda4fb tempest-VolumesTestJSON-1801025123 tempest-VolumesTestJSON-1801025123-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/a21dc924-f6f9-4131-b9b0-979f276970e9" status: 200 len: 351 microversion: 2.1 time: 0.072222 May 19 06:32:09.244694 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 67/132] 10.222.0.65 () {58 vars in 1244 bytes} [Thu May 19 06:32:09 2022] GET /compute/v2.1/os-volumes/a21dc924-f6f9-4131-b9b0-979f276970e9 => generated 351 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:32:09.358752 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3d13d69f-43e9-4921-a492-a099bd86b6c7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:09.359726 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-3d13d69f-43e9-4921-a492-a099bd86b6c7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:09.370062 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3d13d69f-43e9-4921-a492-a099bd86b6c7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:09.370719 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3d13d69f-43e9-4921-a492-a099bd86b6c7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:09.372002 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3d13d69f-43e9-4921-a492-a099bd86b6c7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:09.373017 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3d13d69f-43e9-4921-a492-a099bd86b6c7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:09.588327 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3d13d69f-43e9-4921-a492-a099bd86b6c7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:09.588327 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:32:09.605065 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-3d13d69f-43e9-4921-a492-a099bd86b6c7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.251573 May 19 06:32:09.610769 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 66/133] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:09 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:10.628010 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b3fa1c3e-aaf8-4bcf-a5a2-066331ae6078 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:10.628905 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b3fa1c3e-aaf8-4bcf-a5a2-066331ae6078 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:10.633962 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:32:10.642050 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b3fa1c3e-aaf8-4bcf-a5a2-066331ae6078 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:10.642522 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b3fa1c3e-aaf8-4bcf-a5a2-066331ae6078 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:10.643301 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b3fa1c3e-aaf8-4bcf-a5a2-066331ae6078 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:10.643741 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b3fa1c3e-aaf8-4bcf-a5a2-066331ae6078 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:10.761356 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-00510514-c7ec-4624-9f8d-846141fe457c tempest-VolumesTestJSON-1801025123 tempest-VolumesTestJSON-1801025123-project] Calling method '.version_select at 0x7f9aeb6d7c10>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:10.803480 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b3fa1c3e-aaf8-4bcf-a5a2-066331ae6078 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:10.815390 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b3fa1c3e-aaf8-4bcf-a5a2-066331ae6078 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.191350 May 19 06:32:10.815982 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 68/134] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:10 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:10.824208 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-00510514-c7ec-4624-9f8d-846141fe457c tempest-VolumesTestJSON-1801025123 tempest-VolumesTestJSON-1801025123-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/1f152cbc-e3dc-46eb-afe2-d71df20f59cf" status: 200 len: 350 microversion: 2.1 time: 0.067444 May 19 06:32:10.824892 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 67/135] 10.222.0.65 () {58 vars in 1244 bytes} [Thu May 19 06:32:10 2022] GET /compute/v2.1/os-volumes/1f152cbc-e3dc-46eb-afe2-d71df20f59cf => generated 350 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:32:10.836919 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-cc473616-83ca-488b-880e-f4e16a72a3ad tempest-VolumesTestJSON-1801025123 tempest-VolumesTestJSON-1801025123-project] Calling method '.version_select at 0x7f9aeaf8f790>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:10.923914 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-cc473616-83ca-488b-880e-f4e16a72a3ad tempest-VolumesTestJSON-1801025123 tempest-VolumesTestJSON-1801025123-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.091277 May 19 06:32:10.924499 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 69/136] 10.222.0.65 () {58 vars in 1133 bytes} [Thu May 19 06:32:10 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:10.937485 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a79ec31e-e083-45f6-b563-d28ead360cd7 tempest-VolumesTestJSON-1801025123 tempest-VolumesTestJSON-1801025123-project] Calling method '.version_select at 0x7f9af0286ca0>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:11.064367 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a79ec31e-e083-45f6-b563-d28ead360cd7 tempest-VolumesTestJSON-1801025123 tempest-VolumesTestJSON-1801025123-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.130979 May 19 06:32:11.065004 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 68/137] 10.222.0.65 () {58 vars in 1148 bytes} [Thu May 19 06:32:10 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:32:11.083902 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-5e2d53e3-d521-40d6-b294-0dbb84f3adc3 tempest-VolumesTestJSON-1801025123 tempest-VolumesTestJSON-1801025123-project] Calling method '.version_select at 0x7f9aeaf82430>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:11.200655 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-5e2d53e3-d521-40d6-b294-0dbb84f3adc3 tempest-VolumesTestJSON-1801025123 tempest-VolumesTestJSON-1801025123-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.126133 May 19 06:32:11.201984 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 70/138] 10.222.0.65 () {58 vars in 1133 bytes} [Thu May 19 06:32:11 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:11.219402 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d5eb3586-f89b-4638-ae7a-a0a5e54fba29 tempest-VolumesTestJSON-1801025123 tempest-VolumesTestJSON-1801025123-project] Calling method '.version_select at 0x7f9aeb7a58b0>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:11.402931 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d5eb3586-f89b-4638-ae7a-a0a5e54fba29 tempest-VolumesTestJSON-1801025123 tempest-VolumesTestJSON-1801025123-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.186254 May 19 06:32:11.414920 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 69/139] 10.222.0.65 () {58 vars in 1166 bytes} [Thu May 19 06:32:11 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:32:11.424823 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0e67d930-9b35-41a9-9bb4-f73613c210d4 tempest-VolumesTestJSON-1801025123 tempest-VolumesTestJSON-1801025123-project] Calling method '.version_select at 0x7f9af00e3430>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:11.598582 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0e67d930-9b35-41a9-9bb4-f73613c210d4 tempest-VolumesTestJSON-1801025123 tempest-VolumesTestJSON-1801025123-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.179521 May 19 06:32:11.607035 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 71/140] 10.222.0.65 () {58 vars in 1169 bytes} [Thu May 19 06:32:11 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:32:11.639702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ed16742e-911f-4231-8a81-0d9104c4a8ec tempest-VolumesTestJSON-1801025123 tempest-VolumesTestJSON-1801025123-project] Calling method '.version_select at 0x7f9aeb7a5b80>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:11.744183 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ed16742e-911f-4231-8a81-0d9104c4a8ec tempest-VolumesTestJSON-1801025123 tempest-VolumesTestJSON-1801025123-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.133367 May 19 06:32:11.744768 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 70/141] 10.222.0.65 () {58 vars in 1154 bytes} [Thu May 19 06:32:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:11.756965 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-75ba8acf-0f3c-4385-b5b9-1eb8a58eb848 tempest-VolumesTestJSON-1801025123 tempest-VolumesTestJSON-1801025123-project] Calling method '.version_select at 0x7f9aeafe2e50>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:11.834245 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5f91d5b7-dfa0-45cd-9344-74c095c14ce3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:11.835249 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5f91d5b7-dfa0-45cd-9344-74c095c14ce3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:11.850058 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5f91d5b7-dfa0-45cd-9344-74c095c14ce3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:11.850781 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5f91d5b7-dfa0-45cd-9344-74c095c14ce3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:11.851469 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-75ba8acf-0f3c-4385-b5b9-1eb8a58eb848 tempest-VolumesTestJSON-1801025123 tempest-VolumesTestJSON-1801025123-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.098694 May 19 06:32:11.852048 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5f91d5b7-dfa0-45cd-9344-74c095c14ce3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:11.852778 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5f91d5b7-dfa0-45cd-9344-74c095c14ce3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:11.852971 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 72/142] 10.222.0.65 () {58 vars in 1187 bytes} [Thu May 19 06:32:11 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:32:11.865997 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-8182909d-d80f-4893-95ec-c0ae0272a8da tempest-VolumesTestJSON-1801025123 tempest-VolumesTestJSON-1801025123-project] Calling method '.version_select at 0x7f9aeaf825e0>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:12.007273 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-8182909d-d80f-4893-95ec-c0ae0272a8da tempest-VolumesTestJSON-1801025123 tempest-VolumesTestJSON-1801025123-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.145973 May 19 06:32:12.008162 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 73/143] 10.222.0.65 () {58 vars in 1154 bytes} [Thu May 19 06:32:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:32:12.037787 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5f91d5b7-dfa0-45cd-9344-74c095c14ce3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:12.053479 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5f91d5b7-dfa0-45cd-9344-74c095c14ce3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.222844 May 19 06:32:12.058387 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 71/144] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:11 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:13.073149 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-283c87b4-a726-46a7-a7e4-563d1fe10b62 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:13.073991 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-283c87b4-a726-46a7-a7e4-563d1fe10b62 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:13.080974 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-283c87b4-a726-46a7-a7e4-563d1fe10b62 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:13.081458 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-283c87b4-a726-46a7-a7e4-563d1fe10b62 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:13.082617 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-283c87b4-a726-46a7-a7e4-563d1fe10b62 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:13.082617 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-283c87b4-a726-46a7-a7e4-563d1fe10b62 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:13.291295 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-283c87b4-a726-46a7-a7e4-563d1fe10b62 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:13.302625 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-283c87b4-a726-46a7-a7e4-563d1fe10b62 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.234212 May 19 06:32:13.303811 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 74/145] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:13 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:14.335414 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3933fb5f-6261-41f5-873c-b0660f969712 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:14.339165 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-3933fb5f-6261-41f5-873c-b0660f969712 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:14.349530 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3933fb5f-6261-41f5-873c-b0660f969712 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:14.350129 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3933fb5f-6261-41f5-873c-b0660f969712 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:14.351685 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3933fb5f-6261-41f5-873c-b0660f969712 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:14.352489 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3933fb5f-6261-41f5-873c-b0660f969712 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:14.625426 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3933fb5f-6261-41f5-873c-b0660f969712 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:14.634328 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-3933fb5f-6261-41f5-873c-b0660f969712 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.306036 May 19 06:32:14.634920 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 72/146] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:14 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:15.653544 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-234d6dcd-8b15-4f1e-8889-4e535a9c4dce tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:15.654961 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-234d6dcd-8b15-4f1e-8889-4e535a9c4dce tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:15.668953 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-234d6dcd-8b15-4f1e-8889-4e535a9c4dce tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:15.669945 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-234d6dcd-8b15-4f1e-8889-4e535a9c4dce tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:15.671174 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-234d6dcd-8b15-4f1e-8889-4e535a9c4dce tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:15.671772 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-234d6dcd-8b15-4f1e-8889-4e535a9c4dce tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:15.895839 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-234d6dcd-8b15-4f1e-8889-4e535a9c4dce tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:15.914705 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-234d6dcd-8b15-4f1e-8889-4e535a9c4dce tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.265959 May 19 06:32:15.916735 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 75/147] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:15 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:16.933376 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-01a3ec03-ac90-4d71-beff-4d890cbfd7ed tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:16.934923 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-01a3ec03-ac90-4d71-beff-4d890cbfd7ed tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:16.945178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-01a3ec03-ac90-4d71-beff-4d890cbfd7ed tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:16.946842 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-01a3ec03-ac90-4d71-beff-4d890cbfd7ed tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:16.948302 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-01a3ec03-ac90-4d71-beff-4d890cbfd7ed tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:16.949020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-01a3ec03-ac90-4d71-beff-4d890cbfd7ed tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:17.194702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-01a3ec03-ac90-4d71-beff-4d890cbfd7ed tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:17.204730 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-01a3ec03-ac90-4d71-beff-4d890cbfd7ed tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.275801 May 19 06:32:17.205370 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 73/148] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:16 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:18.232973 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2bf21e49-7c2d-4322-8326-ecd4b3309481 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:18.233975 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-2bf21e49-7c2d-4322-8326-ecd4b3309481 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:18.242115 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2bf21e49-7c2d-4322-8326-ecd4b3309481 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:18.247237 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2bf21e49-7c2d-4322-8326-ecd4b3309481 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:18.249476 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2bf21e49-7c2d-4322-8326-ecd4b3309481 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:18.250260 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2bf21e49-7c2d-4322-8326-ecd4b3309481 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:18.510803 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-2bf21e49-7c2d-4322-8326-ecd4b3309481 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:18.533939 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2bf21e49-7c2d-4322-8326-ecd4b3309481 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.304746 May 19 06:32:18.536814 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 76/149] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:18 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:19.563073 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-53a6a5dc-0445-44c3-a350-be11ec096559 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:19.564338 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-53a6a5dc-0445-44c3-a350-be11ec096559 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:19.576404 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-53a6a5dc-0445-44c3-a350-be11ec096559 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:19.577426 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-53a6a5dc-0445-44c3-a350-be11ec096559 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:19.578658 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-53a6a5dc-0445-44c3-a350-be11ec096559 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:19.579092 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-53a6a5dc-0445-44c3-a350-be11ec096559 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:19.751988 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-53a6a5dc-0445-44c3-a350-be11ec096559 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:19.763914 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-53a6a5dc-0445-44c3-a350-be11ec096559 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.206264 May 19 06:32:19.765218 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 74/150] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:19 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:20.791682 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d2878e04-baca-48ab-ad59-df8603cc3ae5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:20.793022 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d2878e04-baca-48ab-ad59-df8603cc3ae5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:20.805164 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d2878e04-baca-48ab-ad59-df8603cc3ae5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:20.805902 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d2878e04-baca-48ab-ad59-df8603cc3ae5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:20.807647 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d2878e04-baca-48ab-ad59-df8603cc3ae5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:20.808421 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d2878e04-baca-48ab-ad59-df8603cc3ae5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:21.067775 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d2878e04-baca-48ab-ad59-df8603cc3ae5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:21.076842 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d2878e04-baca-48ab-ad59-df8603cc3ae5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.293023 May 19 06:32:21.077494 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 77/151] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:20 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:22.096673 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a8f4156c-f5bc-4bcb-8157-fc2238eba63f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:22.098972 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a8f4156c-f5bc-4bcb-8157-fc2238eba63f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:22.115036 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a8f4156c-f5bc-4bcb-8157-fc2238eba63f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:22.116244 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a8f4156c-f5bc-4bcb-8157-fc2238eba63f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:22.117519 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a8f4156c-f5bc-4bcb-8157-fc2238eba63f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:22.118264 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a8f4156c-f5bc-4bcb-8157-fc2238eba63f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:22.393445 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a8f4156c-f5bc-4bcb-8157-fc2238eba63f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:22.403532 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a8f4156c-f5bc-4bcb-8157-fc2238eba63f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.311982 May 19 06:32:22.405463 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 75/152] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:22 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:32:23.431879 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-794aa78b-5ca7-44a5-8e6e-7464e7d59d97 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:23.433126 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-794aa78b-5ca7-44a5-8e6e-7464e7d59d97 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:23.440169 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-794aa78b-5ca7-44a5-8e6e-7464e7d59d97 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:23.440670 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-794aa78b-5ca7-44a5-8e6e-7464e7d59d97 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:23.442559 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-794aa78b-5ca7-44a5-8e6e-7464e7d59d97 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:23.442995 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-794aa78b-5ca7-44a5-8e6e-7464e7d59d97 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:23.690088 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-794aa78b-5ca7-44a5-8e6e-7464e7d59d97 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:23.700077 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-794aa78b-5ca7-44a5-8e6e-7464e7d59d97 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.278890 May 19 06:32:23.700749 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 78/153] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:23 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:24.720244 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-87d77299-acb1-40d2-a570-7dc15a4bd08b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:24.720879 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-87d77299-acb1-40d2-a570-7dc15a4bd08b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:24.728032 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-87d77299-acb1-40d2-a570-7dc15a4bd08b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:24.728482 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-87d77299-acb1-40d2-a570-7dc15a4bd08b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:24.729260 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-87d77299-acb1-40d2-a570-7dc15a4bd08b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:24.729804 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-87d77299-acb1-40d2-a570-7dc15a4bd08b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:24.880091 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-87d77299-acb1-40d2-a570-7dc15a4bd08b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:24.888797 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-87d77299-acb1-40d2-a570-7dc15a4bd08b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.174045 May 19 06:32:24.889435 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 76/154] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:24 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:25.907272 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e76f2f01-4374-41e9-8475-90c3a9853c08 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:25.907929 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e76f2f01-4374-41e9-8475-90c3a9853c08 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:25.916260 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e76f2f01-4374-41e9-8475-90c3a9853c08 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:25.916702 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e76f2f01-4374-41e9-8475-90c3a9853c08 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:25.917512 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e76f2f01-4374-41e9-8475-90c3a9853c08 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:25.917940 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e76f2f01-4374-41e9-8475-90c3a9853c08 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:26.065069 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e76f2f01-4374-41e9-8475-90c3a9853c08 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:26.074914 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e76f2f01-4374-41e9-8475-90c3a9853c08 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.171744 May 19 06:32:26.075760 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 79/155] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:25 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:26.594965 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-9c771268-6f5c-46e5-a468-3dea11526f6e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-954014254", "imageRef": "27959167-098e-44c5-ba0a-e9fb8054c377", "flavorRef": "452", "networks": [{"uuid": "a8a787e6-32b8-4da9-92d6-017ec62447d1"}]}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:32:26.658102 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.network.neutron [None req-9c771268-6f5c-46e5-a468-3dea11526f6e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] validate_networks() for [('a8a787e6-32b8-4da9-92d6-017ec62447d1', None, None, None, None, None)] {{(pid=117711) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 06:32:27.091766 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-9c771268-6f5c-46e5-a468-3dea11526f6e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Flavor limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 06:32:27.092372 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-9c771268-6f5c-46e5-a468-3dea11526f6e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Image limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 06:32:27.093171 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-9c771268-6f5c-46e5-a468-3dea11526f6e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Flavor pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 06:32:27.093847 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-9c771268-6f5c-46e5-a468-3dea11526f6e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Image pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 06:32:27.094532 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-9c771268-6f5c-46e5-a468-3dea11526f6e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 06:32:27.096446 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c0b6591e-3090-4a79-b2f0-06bfcc177763 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:27.098142 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c0b6591e-3090-4a79-b2f0-06bfcc177763 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:27.109014 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c0b6591e-3090-4a79-b2f0-06bfcc177763 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:27.109940 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9c771268-6f5c-46e5-a468-3dea11526f6e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:27.110172 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c0b6591e-3090-4a79-b2f0-06bfcc177763 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:27.110973 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9c771268-6f5c-46e5-a468-3dea11526f6e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:27.111461 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c0b6591e-3090-4a79-b2f0-06bfcc177763 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:27.112325 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c0b6591e-3090-4a79-b2f0-06bfcc177763 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:27.112529 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9c771268-6f5c-46e5-a468-3dea11526f6e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:27.113816 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9c771268-6f5c-46e5-a468-3dea11526f6e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:27.119929 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=73 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:32:27.143848 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-9c771268-6f5c-46e5-a468-3dea11526f6e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Getting quotas for project af231f2d98544631857757d5b48fd918. Resources: {'ram', 'cores', 'instances'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:32:27.151089 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-9c771268-6f5c-46e5-a468-3dea11526f6e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Getting quotas for user ce2c7ead49a047c6bc04a783ed0bfc43 and project af231f2d98544631857757d5b48fd918. Resources: {'ram', 'cores', 'instances'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:32:27.170904 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-9c771268-6f5c-46e5-a468-3dea11526f6e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Going to run 1 instances... {{(pid=117711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 06:32:27.173543 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-9c771268-6f5c-46e5-a468-3dea11526f6e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27959167-098e-44c5-ba0a-e9fb8054c377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 06:32:27.228012 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-9c771268-6f5c-46e5-a468-3dea11526f6e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637074 May 19 06:32:27.228946 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 77/156] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 06:32:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 06:32:27.239244 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-4c6cd9ef-5640-4b39-85ee-5bf32155d3b8 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:27.239862 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-4c6cd9ef-5640-4b39-85ee-5bf32155d3b8 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:27.315166 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c0b6591e-3090-4a79-b2f0-06bfcc177763 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:27.325066 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c0b6591e-3090-4a79-b2f0-06bfcc177763 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.235116 May 19 06:32:27.325689 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 80/157] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:27 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:32:27.338144 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4c6cd9ef-5640-4b39-85ee-5bf32155d3b8 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:27.347227 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-4c6cd9ef-5640-4b39-85ee-5bf32155d3b8 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1213 microversion: 2.1 time: 0.111935 May 19 06:32:27.348368 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 78/158] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:27 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1213 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:32:28.350870 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-84c7e8a6-904d-41ed-be96-234461caddbc tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:28.351509 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-84c7e8a6-904d-41ed-be96-234461caddbc tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:28.357792 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-84c7e8a6-904d-41ed-be96-234461caddbc tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:28.358236 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-84c7e8a6-904d-41ed-be96-234461caddbc tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:28.358993 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-84c7e8a6-904d-41ed-be96-234461caddbc tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:28.359420 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-84c7e8a6-904d-41ed-be96-234461caddbc tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:28.364603 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8c409c27-64a3-4548-a082-55826a043aeb tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:28.365366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8c409c27-64a3-4548-a082-55826a043aeb tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:28.372088 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8c409c27-64a3-4548-a082-55826a043aeb tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:28.372634 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8c409c27-64a3-4548-a082-55826a043aeb tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:28.373533 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8c409c27-64a3-4548-a082-55826a043aeb tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:28.374038 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8c409c27-64a3-4548-a082-55826a043aeb tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:28.435285 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-8c409c27-64a3-4548-a082-55826a043aeb tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:28.443671 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8c409c27-64a3-4548-a082-55826a043aeb tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1217 microversion: 2.1 time: 0.083207 May 19 06:32:28.444269 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 79/159] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:28 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:32:28.498510 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-84c7e8a6-904d-41ed-be96-234461caddbc tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:28.506622 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-84c7e8a6-904d-41ed-be96-234461caddbc tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.159876 May 19 06:32:28.507190 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 81/160] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:28 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:29.460175 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-50cc083d-934d-4605-acf4-52dc9f478eb3 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:29.460785 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-50cc083d-934d-4605-acf4-52dc9f478eb3 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:29.467532 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-50cc083d-934d-4605-acf4-52dc9f478eb3 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:29.467964 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-50cc083d-934d-4605-acf4-52dc9f478eb3 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:29.468736 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-50cc083d-934d-4605-acf4-52dc9f478eb3 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:29.469166 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-50cc083d-934d-4605-acf4-52dc9f478eb3 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:29.524357 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-03e3dcd2-31f6-4992-8d4f-56859d9ee2f6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:29.525024 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-03e3dcd2-31f6-4992-8d4f-56859d9ee2f6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:29.535816 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-03e3dcd2-31f6-4992-8d4f-56859d9ee2f6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:29.536419 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-03e3dcd2-31f6-4992-8d4f-56859d9ee2f6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:29.537467 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-03e3dcd2-31f6-4992-8d4f-56859d9ee2f6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:29.538083 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-03e3dcd2-31f6-4992-8d4f-56859d9ee2f6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:29.546466 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-50cc083d-934d-4605-acf4-52dc9f478eb3 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:29.556506 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-50cc083d-934d-4605-acf4-52dc9f478eb3 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1265 microversion: 2.1 time: 0.100010 May 19 06:32:29.557698 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 80/161] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:29 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1265 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:29.709723 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-03e3dcd2-31f6-4992-8d4f-56859d9ee2f6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:29.717916 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-03e3dcd2-31f6-4992-8d4f-56859d9ee2f6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.198038 May 19 06:32:29.718508 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 82/162] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:29 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:32:30.575640 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-2fe331ae-88e0-44bf-a4d7-6c552f761db5 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:30.576258 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-2fe331ae-88e0-44bf-a4d7-6c552f761db5 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:30.583599 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2fe331ae-88e0-44bf-a4d7-6c552f761db5 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:30.584104 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2fe331ae-88e0-44bf-a4d7-6c552f761db5 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:30.584852 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2fe331ae-88e0-44bf-a4d7-6c552f761db5 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:30.585422 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2fe331ae-88e0-44bf-a4d7-6c552f761db5 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:30.648728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2fe331ae-88e0-44bf-a4d7-6c552f761db5 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:30.656684 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-2fe331ae-88e0-44bf-a4d7-6c552f761db5 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1265 microversion: 2.1 time: 0.084915 May 19 06:32:30.657252 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 81/163] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:30 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:30.735046 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b71ed349-9fa7-4b7b-92e4-7371c9fbe15c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:30.735689 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b71ed349-9fa7-4b7b-92e4-7371c9fbe15c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:30.741742 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b71ed349-9fa7-4b7b-92e4-7371c9fbe15c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:30.742189 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b71ed349-9fa7-4b7b-92e4-7371c9fbe15c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:30.742944 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b71ed349-9fa7-4b7b-92e4-7371c9fbe15c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:30.743369 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b71ed349-9fa7-4b7b-92e4-7371c9fbe15c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:30.877922 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b71ed349-9fa7-4b7b-92e4-7371c9fbe15c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:30.886954 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b71ed349-9fa7-4b7b-92e4-7371c9fbe15c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.155543 May 19 06:32:30.887659 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 83/164] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:30 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:31.673633 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c73c782e-3fcf-4ad9-8bf2-a6b6c784270a tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:31.674483 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c73c782e-3fcf-4ad9-8bf2-a6b6c784270a tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:31.681133 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c73c782e-3fcf-4ad9-8bf2-a6b6c784270a tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:31.681603 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c73c782e-3fcf-4ad9-8bf2-a6b6c784270a tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:31.682365 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c73c782e-3fcf-4ad9-8bf2-a6b6c784270a tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:31.682789 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c73c782e-3fcf-4ad9-8bf2-a6b6c784270a tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:31.755524 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c73c782e-3fcf-4ad9-8bf2-a6b6c784270a tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:31.769660 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c73c782e-3fcf-4ad9-8bf2-a6b6c784270a tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1265 microversion: 2.1 time: 0.099021 May 19 06:32:31.770584 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 82/165] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:31 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1265 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:32:31.905272 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-cd722008-d583-4b4f-9a40-2ecbcde69060 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:31.905923 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-cd722008-d583-4b4f-9a40-2ecbcde69060 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:31.915726 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cd722008-d583-4b4f-9a40-2ecbcde69060 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:31.916505 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cd722008-d583-4b4f-9a40-2ecbcde69060 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:31.917458 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cd722008-d583-4b4f-9a40-2ecbcde69060 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:31.918209 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cd722008-d583-4b4f-9a40-2ecbcde69060 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:32.125577 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-cd722008-d583-4b4f-9a40-2ecbcde69060 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:32.134368 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-cd722008-d583-4b4f-9a40-2ecbcde69060 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.233125 May 19 06:32:32.134994 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 84/166] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:31 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:32:32.467912 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-fb08af3e-c231-4167-b85f-9abc918ab168 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:32.468291 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-fb08af3e-c231-4167-b85f-9abc918ab168 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:32.475535 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fb08af3e-c231-4167-b85f-9abc918ab168 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:32.476037 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fb08af3e-c231-4167-b85f-9abc918ab168 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:32.476734 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fb08af3e-c231-4167-b85f-9abc918ab168 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:32.477163 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fb08af3e-c231-4167-b85f-9abc918ab168 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:32.501166 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-fb08af3e-c231-4167-b85f-9abc918ab168 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf/ips" status: 200 len: 148 microversion: 2.1 time: 0.037224 May 19 06:32:32.501808 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 83/167] 10.222.0.65 () {58 vars in 1247 bytes} [Thu May 19 06:32:32 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:32:32.789669 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e8d2fcd6-36ef-40ce-9f19-9913d735c3ff tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:32.790478 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e8d2fcd6-36ef-40ce-9f19-9913d735c3ff tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:32.797655 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e8d2fcd6-36ef-40ce-9f19-9913d735c3ff tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:32.798336 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e8d2fcd6-36ef-40ce-9f19-9913d735c3ff tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:32.799137 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e8d2fcd6-36ef-40ce-9f19-9913d735c3ff tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:32.801189 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e8d2fcd6-36ef-40ce-9f19-9913d735c3ff tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:32.883273 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e8d2fcd6-36ef-40ce-9f19-9913d735c3ff tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:32.904920 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e8d2fcd6-36ef-40ce-9f19-9913d735c3ff tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1271 microversion: 2.1 time: 0.119621 May 19 06:32:32.907919 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 85/168] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:32 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1271 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:33.152156 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8bd879b1-9072-414a-a324-8e3d0cf213c6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:33.153534 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8bd879b1-9072-414a-a324-8e3d0cf213c6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:33.163632 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8bd879b1-9072-414a-a324-8e3d0cf213c6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:33.164264 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8bd879b1-9072-414a-a324-8e3d0cf213c6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:33.165226 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8bd879b1-9072-414a-a324-8e3d0cf213c6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:33.165951 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8bd879b1-9072-414a-a324-8e3d0cf213c6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:33.359890 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-8bd879b1-9072-414a-a324-8e3d0cf213c6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:33.374441 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8bd879b1-9072-414a-a324-8e3d0cf213c6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.225871 May 19 06:32:33.375506 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 84/169] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:33 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:33.927300 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3b37c3dc-a905-44c2-b105-cc6ab6fd5951 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:33.928158 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3b37c3dc-a905-44c2-b105-cc6ab6fd5951 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:33.936654 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3b37c3dc-a905-44c2-b105-cc6ab6fd5951 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:33.937170 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3b37c3dc-a905-44c2-b105-cc6ab6fd5951 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:33.938111 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3b37c3dc-a905-44c2-b105-cc6ab6fd5951 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:33.938610 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3b37c3dc-a905-44c2-b105-cc6ab6fd5951 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:34.092278 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3b37c3dc-a905-44c2-b105-cc6ab6fd5951 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:34.100290 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3b37c3dc-a905-44c2-b105-cc6ab6fd5951 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1313 microversion: 2.1 time: 0.178593 May 19 06:32:34.100868 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 86/170] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:33 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:32:34.400349 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-cea7965b-2b8a-42bc-94c2-732fb48fb388 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:34.400967 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-cea7965b-2b8a-42bc-94c2-732fb48fb388 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:34.407808 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cea7965b-2b8a-42bc-94c2-732fb48fb388 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:34.408258 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cea7965b-2b8a-42bc-94c2-732fb48fb388 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:34.409023 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cea7965b-2b8a-42bc-94c2-732fb48fb388 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:34.410287 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cea7965b-2b8a-42bc-94c2-732fb48fb388 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:34.542779 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-cea7965b-2b8a-42bc-94c2-732fb48fb388 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:34.555080 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-cea7965b-2b8a-42bc-94c2-732fb48fb388 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.158599 May 19 06:32:34.556299 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 85/171] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:34 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:35.119221 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2cf1b447-f38e-40b7-8878-11ac2948446c tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:35.119851 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-2cf1b447-f38e-40b7-8878-11ac2948446c tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:35.126191 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2cf1b447-f38e-40b7-8878-11ac2948446c tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:35.126642 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2cf1b447-f38e-40b7-8878-11ac2948446c tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:35.127429 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2cf1b447-f38e-40b7-8878-11ac2948446c tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:35.127860 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2cf1b447-f38e-40b7-8878-11ac2948446c tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:35.260798 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-2cf1b447-f38e-40b7-8878-11ac2948446c tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:35.268215 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2cf1b447-f38e-40b7-8878-11ac2948446c tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1313 microversion: 2.1 time: 0.153610 May 19 06:32:35.268796 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 87/172] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:35 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:35.574826 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-553b4a4a-0305-4dd8-9a29-e363f984e873 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:35.575435 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-553b4a4a-0305-4dd8-9a29-e363f984e873 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:35.581940 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-553b4a4a-0305-4dd8-9a29-e363f984e873 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:35.582384 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-553b4a4a-0305-4dd8-9a29-e363f984e873 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:35.583147 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-553b4a4a-0305-4dd8-9a29-e363f984e873 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:35.583607 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-553b4a4a-0305-4dd8-9a29-e363f984e873 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:35.718787 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-553b4a4a-0305-4dd8-9a29-e363f984e873 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:35.727218 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-553b4a4a-0305-4dd8-9a29-e363f984e873 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.156270 May 19 06:32:35.727789 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 86/173] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:35 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:36.276896 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-4844f11a-a915-44d9-befe-d04c9855fbec req-40499ed3-7147-441a-8ac0-547c02c2c705 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a17c90e2-1f91-492e-ae74-56e09b7b73fc", "tag": "886112b1-affd-4a9c-b3b1-64b34b4fb264"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:32:36.288166 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-4844f11a-a915-44d9-befe-d04c9855fbec req-40499ed3-7147-441a-8ac0-547c02c2c705 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:36.288872 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-4844f11a-a915-44d9-befe-d04c9855fbec req-40499ed3-7147-441a-8ac0-547c02c2c705 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:36.294037 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ad10d812-1ab1-4b68-b5ba-604d60109c71 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:36.295405 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ad10d812-1ab1-4b68-b5ba-604d60109c71 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:36.308037 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-4844f11a-a915-44d9-befe-d04c9855fbec req-40499ed3-7147-441a-8ac0-547c02c2c705 service nova] Creating event network-changed:886112b1-affd-4a9c-b3b1-64b34b4fb264 for instance a17c90e2-1f91-492e-ae74-56e09b7b73fc on hv-cinder-83699 May 19 06:32:36.308676 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ad10d812-1ab1-4b68-b5ba-604d60109c71 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:36.309881 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ad10d812-1ab1-4b68-b5ba-604d60109c71 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:36.313380 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ad10d812-1ab1-4b68-b5ba-604d60109c71 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:36.313779 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-4844f11a-a915-44d9-befe-d04c9855fbec req-40499ed3-7147-441a-8ac0-547c02c2c705 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041874 May 19 06:32:36.314363 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 88/174] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:32:36.314721 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ad10d812-1ab1-4b68-b5ba-604d60109c71 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:36.469667 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ad10d812-1ab1-4b68-b5ba-604d60109c71 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:36.481604 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ad10d812-1ab1-4b68-b5ba-604d60109c71 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1313 microversion: 2.1 time: 0.197219 May 19 06:32:36.481774 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 87/175] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:36 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:36.744681 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0ad4e813-a794-4b05-82b6-ba627189a417 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:36.745439 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0ad4e813-a794-4b05-82b6-ba627189a417 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:36.751751 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0ad4e813-a794-4b05-82b6-ba627189a417 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:36.752204 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0ad4e813-a794-4b05-82b6-ba627189a417 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:36.752969 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0ad4e813-a794-4b05-82b6-ba627189a417 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:36.753966 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0ad4e813-a794-4b05-82b6-ba627189a417 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:36.935097 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0ad4e813-a794-4b05-82b6-ba627189a417 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:36.945521 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0ad4e813-a794-4b05-82b6-ba627189a417 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.205051 May 19 06:32:36.946418 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 89/176] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:36 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:37.216914 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e738bce1-7641-4a0c-90f0-82af1e548611 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8b89adf-9170-4772-91d0-d2aa6f49d216"}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:32:37.218073 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e738bce1-7641-4a0c-90f0-82af1e548611 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:37.219893 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:32:37.225926 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e738bce1-7641-4a0c-90f0-82af1e548611 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:37.226367 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e738bce1-7641-4a0c-90f0-82af1e548611 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:37.227133 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e738bce1-7641-4a0c-90f0-82af1e548611 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:37.227556 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e738bce1-7641-4a0c-90f0-82af1e548611 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:37.347295 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=8 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:32:37.498750 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-040c80be-65b8-43a1-81cd-5ea07f9158d0 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:37.499482 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-040c80be-65b8-43a1-81cd-5ea07f9158d0 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:37.506928 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-040c80be-65b8-43a1-81cd-5ea07f9158d0 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:37.507459 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-040c80be-65b8-43a1-81cd-5ea07f9158d0 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:37.508413 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-040c80be-65b8-43a1-81cd-5ea07f9158d0 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:37.508846 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-040c80be-65b8-43a1-81cd-5ea07f9158d0 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:37.835222 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-040c80be-65b8-43a1-81cd-5ea07f9158d0 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:37.842809 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-040c80be-65b8-43a1-81cd-5ea07f9158d0 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1313 microversion: 2.1 time: 0.348074 May 19 06:32:37.843384 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 90/177] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:37 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:37.964494 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a08e43d4-21d7-45e6-9b3d-23c3ce9a1af9 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:37.965098 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a08e43d4-21d7-45e6-9b3d-23c3ce9a1af9 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:37.971203 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a08e43d4-21d7-45e6-9b3d-23c3ce9a1af9 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:37.971654 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a08e43d4-21d7-45e6-9b3d-23c3ce9a1af9 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:37.972467 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a08e43d4-21d7-45e6-9b3d-23c3ce9a1af9 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:37.972854 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a08e43d4-21d7-45e6-9b3d-23c3ce9a1af9 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:38.109247 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a08e43d4-21d7-45e6-9b3d-23c3ce9a1af9 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:38.118393 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a08e43d4-21d7-45e6-9b3d-23c3ce9a1af9 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.158278 May 19 06:32:38.118970 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 91/178] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:37 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:32:38.860566 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6def3364-14ac-4273-972f-a160df2d476d tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:38.861220 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-6def3364-14ac-4273-972f-a160df2d476d tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:38.868136 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6def3364-14ac-4273-972f-a160df2d476d tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:38.868581 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6def3364-14ac-4273-972f-a160df2d476d tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:38.869353 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6def3364-14ac-4273-972f-a160df2d476d tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:38.869783 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6def3364-14ac-4273-972f-a160df2d476d tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:39.019086 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6def3364-14ac-4273-972f-a160df2d476d tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:39.028815 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6def3364-14ac-4273-972f-a160df2d476d tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1313 microversion: 2.1 time: 0.171966 May 19 06:32:39.029682 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 92/179] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:38 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:32:39.134840 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b8059e70-9841-4e7f-b563-f64f4419229e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:39.135457 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b8059e70-9841-4e7f-b563-f64f4419229e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:39.141725 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b8059e70-9841-4e7f-b563-f64f4419229e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:39.142181 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b8059e70-9841-4e7f-b563-f64f4419229e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:39.142958 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b8059e70-9841-4e7f-b563-f64f4419229e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:39.143395 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b8059e70-9841-4e7f-b563-f64f4419229e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:39.288619 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b8059e70-9841-4e7f-b563-f64f4419229e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:39.297407 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b8059e70-9841-4e7f-b563-f64f4419229e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.166302 May 19 06:32:39.298110 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 93/180] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:39 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:32:40.046895 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d3792a88-c007-43c4-a6dc-eb14c6c1d117 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:40.048202 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d3792a88-c007-43c4-a6dc-eb14c6c1d117 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:40.055886 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d3792a88-c007-43c4-a6dc-eb14c6c1d117 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:40.056326 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d3792a88-c007-43c4-a6dc-eb14c6c1d117 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:40.057092 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d3792a88-c007-43c4-a6dc-eb14c6c1d117 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:40.057567 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d3792a88-c007-43c4-a6dc-eb14c6c1d117 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:40.207013 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d3792a88-c007-43c4-a6dc-eb14c6c1d117 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:40.215147 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d3792a88-c007-43c4-a6dc-eb14c6c1d117 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1313 microversion: 2.1 time: 0.172028 May 19 06:32:40.215715 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 94/181] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:40 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:32:40.315230 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-55c3426c-8281-46b7-9dd6-7b3ed9296ab6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:40.315919 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-55c3426c-8281-46b7-9dd6-7b3ed9296ab6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:40.322539 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-55c3426c-8281-46b7-9dd6-7b3ed9296ab6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:40.322986 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-55c3426c-8281-46b7-9dd6-7b3ed9296ab6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:40.323752 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-55c3426c-8281-46b7-9dd6-7b3ed9296ab6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:40.324176 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-55c3426c-8281-46b7-9dd6-7b3ed9296ab6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:40.466081 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-55c3426c-8281-46b7-9dd6-7b3ed9296ab6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:40.474946 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-55c3426c-8281-46b7-9dd6-7b3ed9296ab6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.163627 May 19 06:32:40.475547 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 95/182] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:40 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:32:40.962776 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=98 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:32:41.118705 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e738bce1-7641-4a0c-90f0-82af1e548611 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "POST /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.905160 May 19 06:32:41.119446 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 88/183] 10.222.0.65 () {60 vars in 1322 bytes} [Thu May 19 06:32:37 2022] POST /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf/os-volume_attachments => generated 194 bytes in 3907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:32:41.235375 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d11cb19e-3d0b-4945-bbdd-e29b09c61460 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:41.236011 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d11cb19e-3d0b-4945-bbdd-e29b09c61460 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:41.238332 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=46 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:32:41.244259 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d11cb19e-3d0b-4945-bbdd-e29b09c61460 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:41.244626 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d11cb19e-3d0b-4945-bbdd-e29b09c61460 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:41.245427 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d11cb19e-3d0b-4945-bbdd-e29b09c61460 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:41.245862 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d11cb19e-3d0b-4945-bbdd-e29b09c61460 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:41.394446 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d11cb19e-3d0b-4945-bbdd-e29b09c61460 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:41.402156 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d11cb19e-3d0b-4945-bbdd-e29b09c61460 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1313 microversion: 2.1 time: 0.172186 May 19 06:32:41.402741 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 96/184] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:41 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:41.493678 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e94aa60c-6e54-4165-aff8-282b832dcc78 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:41.494459 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e94aa60c-6e54-4165-aff8-282b832dcc78 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:41.496357 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:32:41.503262 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e94aa60c-6e54-4165-aff8-282b832dcc78 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:41.504543 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e94aa60c-6e54-4165-aff8-282b832dcc78 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:41.505058 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e94aa60c-6e54-4165-aff8-282b832dcc78 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:41.505559 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e94aa60c-6e54-4165-aff8-282b832dcc78 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:41.646653 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e94aa60c-6e54-4165-aff8-282b832dcc78 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:41.655159 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e94aa60c-6e54-4165-aff8-282b832dcc78 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.166700 May 19 06:32:41.655742 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 89/185] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:41 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:42.418173 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ed542b38-9c94-4635-8217-0f40f6b5ed9d tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:42.418774 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ed542b38-9c94-4635-8217-0f40f6b5ed9d tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:42.425142 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ed542b38-9c94-4635-8217-0f40f6b5ed9d tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:42.426453 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ed542b38-9c94-4635-8217-0f40f6b5ed9d tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:42.427277 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ed542b38-9c94-4635-8217-0f40f6b5ed9d tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:42.427715 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ed542b38-9c94-4635-8217-0f40f6b5ed9d tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:42.442820 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=100 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:32:42.560103 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ed542b38-9c94-4635-8217-0f40f6b5ed9d tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:42.568258 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ed542b38-9c94-4635-8217-0f40f6b5ed9d tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1313 microversion: 2.1 time: 0.153787 May 19 06:32:42.568853 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 97/186] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:42 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:42.672899 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f2f8af84-5f83-4d6f-a17d-285d65936fc0 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:42.673516 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f2f8af84-5f83-4d6f-a17d-285d65936fc0 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:42.681298 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f2f8af84-5f83-4d6f-a17d-285d65936fc0 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:42.681844 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f2f8af84-5f83-4d6f-a17d-285d65936fc0 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:42.682684 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f2f8af84-5f83-4d6f-a17d-285d65936fc0 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:42.683131 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f2f8af84-5f83-4d6f-a17d-285d65936fc0 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:42.838204 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f2f8af84-5f83-4d6f-a17d-285d65936fc0 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:42.846250 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f2f8af84-5f83-4d6f-a17d-285d65936fc0 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.177228 May 19 06:32:42.846844 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 90/187] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:42 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:43.585488 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-5561a60f-7f17-4be4-9d4d-158d56b050bd tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:43.586142 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-5561a60f-7f17-4be4-9d4d-158d56b050bd tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:43.592621 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5561a60f-7f17-4be4-9d4d-158d56b050bd tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:43.593135 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5561a60f-7f17-4be4-9d4d-158d56b050bd tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:43.593982 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5561a60f-7f17-4be4-9d4d-158d56b050bd tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:43.594479 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5561a60f-7f17-4be4-9d4d-158d56b050bd tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:43.757718 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-5561a60f-7f17-4be4-9d4d-158d56b050bd tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:43.773863 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-5561a60f-7f17-4be4-9d4d-158d56b050bd tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1313 microversion: 2.1 time: 0.192802 May 19 06:32:43.774883 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 98/188] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:43 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:43.864851 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-51a3f789-9efc-4beb-ac69-5a5df57a2d41 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:43.865433 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-51a3f789-9efc-4beb-ac69-5a5df57a2d41 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:43.872291 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-51a3f789-9efc-4beb-ac69-5a5df57a2d41 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:43.872806 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-51a3f789-9efc-4beb-ac69-5a5df57a2d41 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:43.873648 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-51a3f789-9efc-4beb-ac69-5a5df57a2d41 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:43.874073 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-51a3f789-9efc-4beb-ac69-5a5df57a2d41 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:44.023143 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-51a3f789-9efc-4beb-ac69-5a5df57a2d41 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:44.039393 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-51a3f789-9efc-4beb-ac69-5a5df57a2d41 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1520 microversion: 2.1 time: 0.178771 May 19 06:32:44.040167 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 91/189] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:43 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:32:44.798469 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b8aaa497-35d4-41e8-978e-e4502a595b69 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:44.799194 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b8aaa497-35d4-41e8-978e-e4502a595b69 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:44.805772 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b8aaa497-35d4-41e8-978e-e4502a595b69 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:44.806226 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b8aaa497-35d4-41e8-978e-e4502a595b69 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:44.807000 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b8aaa497-35d4-41e8-978e-e4502a595b69 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:44.807434 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b8aaa497-35d4-41e8-978e-e4502a595b69 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:44.948461 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b8aaa497-35d4-41e8-978e-e4502a595b69 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:44.956512 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b8aaa497-35d4-41e8-978e-e4502a595b69 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1313 microversion: 2.1 time: 0.162478 May 19 06:32:44.957658 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 99/190] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:44 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:45.057221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-61001832-36f4-44c2-a0ee-b0dafef606d5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:45.057886 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-61001832-36f4-44c2-a0ee-b0dafef606d5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:45.064585 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-61001832-36f4-44c2-a0ee-b0dafef606d5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:45.065028 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-61001832-36f4-44c2-a0ee-b0dafef606d5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:45.065971 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-61001832-36f4-44c2-a0ee-b0dafef606d5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:45.067098 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-61001832-36f4-44c2-a0ee-b0dafef606d5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:45.224722 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-61001832-36f4-44c2-a0ee-b0dafef606d5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:45.232766 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-61001832-36f4-44c2-a0ee-b0dafef606d5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1500 microversion: 2.1 time: 0.179325 May 19 06:32:45.233384 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 92/191] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:45 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1500 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:32:45.258276 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-cc0fc8e1-9858-4ba7-843a-6793ccd39157 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:45.259061 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-cc0fc8e1-9858-4ba7-843a-6793ccd39157 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:45.265814 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cc0fc8e1-9858-4ba7-843a-6793ccd39157 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:45.266271 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cc0fc8e1-9858-4ba7-843a-6793ccd39157 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:45.267240 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cc0fc8e1-9858-4ba7-843a-6793ccd39157 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:45.267517 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cc0fc8e1-9858-4ba7-843a-6793ccd39157 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:45.486686 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-cc0fc8e1-9858-4ba7-843a-6793ccd39157 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:45.495097 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-cc0fc8e1-9858-4ba7-843a-6793ccd39157 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1514 microversion: 2.1 time: 0.241309 May 19 06:32:45.495281 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 100/192] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:45 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1514 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:32:45.979997 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-94e18a10-f9e0-4eec-888f-918aba2552d2 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:45.980616 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-94e18a10-f9e0-4eec-888f-918aba2552d2 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:45.991135 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-94e18a10-f9e0-4eec-888f-918aba2552d2 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:45.991634 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-94e18a10-f9e0-4eec-888f-918aba2552d2 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:45.992913 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-94e18a10-f9e0-4eec-888f-918aba2552d2 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:45.996648 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-94e18a10-f9e0-4eec-888f-918aba2552d2 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:46.151280 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-94e18a10-f9e0-4eec-888f-918aba2552d2 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:46.159190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-94e18a10-f9e0-4eec-888f-918aba2552d2 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1313 microversion: 2.1 time: 0.183297 May 19 06:32:46.159783 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 93/193] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:45 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:47.176972 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9db2b770-2d68-46c3-b0b1-c111e032d2b4 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:47.177822 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9db2b770-2d68-46c3-b0b1-c111e032d2b4 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:47.183946 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9db2b770-2d68-46c3-b0b1-c111e032d2b4 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:47.184391 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9db2b770-2d68-46c3-b0b1-c111e032d2b4 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:47.185161 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9db2b770-2d68-46c3-b0b1-c111e032d2b4 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:47.185617 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9db2b770-2d68-46c3-b0b1-c111e032d2b4 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:47.328623 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9db2b770-2d68-46c3-b0b1-c111e032d2b4 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:47.337390 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9db2b770-2d68-46c3-b0b1-c111e032d2b4 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1313 microversion: 2.1 time: 0.165045 May 19 06:32:47.338510 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 101/194] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:47 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:48.354928 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d04fe8e5-b272-4fed-a9e1-7f90fb83d198 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:48.355651 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d04fe8e5-b272-4fed-a9e1-7f90fb83d198 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:48.363775 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d04fe8e5-b272-4fed-a9e1-7f90fb83d198 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:48.364215 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d04fe8e5-b272-4fed-a9e1-7f90fb83d198 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:48.365001 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d04fe8e5-b272-4fed-a9e1-7f90fb83d198 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:48.365465 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d04fe8e5-b272-4fed-a9e1-7f90fb83d198 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:48.507911 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d04fe8e5-b272-4fed-a9e1-7f90fb83d198 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:48.515770 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d04fe8e5-b272-4fed-a9e1-7f90fb83d198 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1313 microversion: 2.1 time: 0.164690 May 19 06:32:48.516355 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 94/195] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:48 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:49.541626 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-40d717d9-341a-4280-9701-8b6baf8b9fa5 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:49.542440 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-40d717d9-341a-4280-9701-8b6baf8b9fa5 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:49.553036 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-40d717d9-341a-4280-9701-8b6baf8b9fa5 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:49.554041 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-40d717d9-341a-4280-9701-8b6baf8b9fa5 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:49.555261 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-40d717d9-341a-4280-9701-8b6baf8b9fa5 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:49.555699 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-40d717d9-341a-4280-9701-8b6baf8b9fa5 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:49.728101 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-40d717d9-341a-4280-9701-8b6baf8b9fa5 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:49.736418 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-40d717d9-341a-4280-9701-8b6baf8b9fa5 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1313 microversion: 2.1 time: 0.202594 May 19 06:32:49.737119 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 102/196] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:49 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:50.151610 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e99006ff-0252-490e-8303-7b11837ab98a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:32:50.154809 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e99006ff-0252-490e-8303-7b11837ab98a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:50.166470 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e99006ff-0252-490e-8303-7b11837ab98a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:50.167275 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e99006ff-0252-490e-8303-7b11837ab98a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:50.168626 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e99006ff-0252-490e-8303-7b11837ab98a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:50.169428 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e99006ff-0252-490e-8303-7b11837ab98a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:50.207703 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-e99006ff-0252-490e-8303-7b11837ab98a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lazy-loading 'flavor' on Instance uuid 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:32:50.293143 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e99006ff-0252-490e-8303-7b11837ab98a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "POST /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e/action" status: 200 len: 32 microversion: 2.1 time: 0.149833 May 19 06:32:50.293800 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 95/197] 10.222.0.65 () {60 vars in 1277 bytes} [Thu May 19 06:32:50 2022] POST /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e/action => generated 32 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 06:32:50.303691 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-29cc5cde-c327-413c-a0a0-897a9a938729 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:50.304300 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-29cc5cde-c327-413c-a0a0-897a9a938729 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:50.314929 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-29cc5cde-c327-413c-a0a0-897a9a938729 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:50.316942 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-29cc5cde-c327-413c-a0a0-897a9a938729 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:50.318640 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-29cc5cde-c327-413c-a0a0-897a9a938729 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:50.319381 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-29cc5cde-c327-413c-a0a0-897a9a938729 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:50.520586 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-29cc5cde-c327-413c-a0a0-897a9a938729 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:50.534400 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-29cc5cde-c327-413c-a0a0-897a9a938729 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.234999 May 19 06:32:50.536156 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 103/198] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:50 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:50.560256 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-fa12eec1-7108-42f3-aefe-8b5bcb73cc50 req-a824c932-cd0b-4382-a9bc-e0092bfeb01e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17c90e2-1f91-492e-ae74-56e09b7b73fc", "name": "network-vif-plugged", "status": "completed", "tag": "886112b1-affd-4a9c-b3b1-64b34b4fb264"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:32:50.572410 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-fa12eec1-7108-42f3-aefe-8b5bcb73cc50 req-a824c932-cd0b-4382-a9bc-e0092bfeb01e service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:50.572892 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-fa12eec1-7108-42f3-aefe-8b5bcb73cc50 req-a824c932-cd0b-4382-a9bc-e0092bfeb01e service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:50.586526 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-fa12eec1-7108-42f3-aefe-8b5bcb73cc50 req-a824c932-cd0b-4382-a9bc-e0092bfeb01e service nova] Creating event network-vif-plugged:886112b1-affd-4a9c-b3b1-64b34b4fb264 for instance a17c90e2-1f91-492e-ae74-56e09b7b73fc on hv-cinder-83699 May 19 06:32:50.591486 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-fa12eec1-7108-42f3-aefe-8b5bcb73cc50 req-a824c932-cd0b-4382-a9bc-e0092bfeb01e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036429 May 19 06:32:50.592094 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 96/199] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:32:50.757733 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-419c6a9b-9b70-4aee-9293-3a32b588e589 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:50.757733 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-419c6a9b-9b70-4aee-9293-3a32b588e589 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:50.763932 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-419c6a9b-9b70-4aee-9293-3a32b588e589 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:50.764781 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-419c6a9b-9b70-4aee-9293-3a32b588e589 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:50.765828 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-419c6a9b-9b70-4aee-9293-3a32b588e589 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:50.768080 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-419c6a9b-9b70-4aee-9293-3a32b588e589 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:51.089490 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-419c6a9b-9b70-4aee-9293-3a32b588e589 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:51.100733 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-419c6a9b-9b70-4aee-9293-3a32b588e589 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1313 microversion: 2.1 time: 0.347598 May 19 06:32:51.101853 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 104/200] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:50 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:51.564230 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c1a4a1cf-e1b8-4c10-99d9-9f42a4b94cde tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:51.565460 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c1a4a1cf-e1b8-4c10-99d9-9f42a4b94cde tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:51.579549 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c1a4a1cf-e1b8-4c10-99d9-9f42a4b94cde tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:51.580385 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c1a4a1cf-e1b8-4c10-99d9-9f42a4b94cde tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:51.581943 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c1a4a1cf-e1b8-4c10-99d9-9f42a4b94cde tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:51.582815 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c1a4a1cf-e1b8-4c10-99d9-9f42a4b94cde tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:51.755481 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c1a4a1cf-e1b8-4c10-99d9-9f42a4b94cde tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:51.774579 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c1a4a1cf-e1b8-4c10-99d9-9f42a4b94cde tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.219928 May 19 06:32:51.775487 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 97/201] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:51 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:52.119678 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-37474655-ae95-4464-93dc-4600a7a5f00e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:52.120296 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-37474655-ae95-4464-93dc-4600a7a5f00e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:52.129082 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-37474655-ae95-4464-93dc-4600a7a5f00e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:52.129554 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-37474655-ae95-4464-93dc-4600a7a5f00e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:52.130337 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-37474655-ae95-4464-93dc-4600a7a5f00e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:52.130768 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-37474655-ae95-4464-93dc-4600a7a5f00e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:52.314388 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-37474655-ae95-4464-93dc-4600a7a5f00e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:52.324734 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-37474655-ae95-4464-93dc-4600a7a5f00e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1313 microversion: 2.1 time: 0.209082 May 19 06:32:52.325541 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 105/202] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:52 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:32:52.794326 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1078216f-f731-49dd-b8b6-05f5aec32931 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:52.795239 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-1078216f-f731-49dd-b8b6-05f5aec32931 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:52.807755 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1078216f-f731-49dd-b8b6-05f5aec32931 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:52.808557 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1078216f-f731-49dd-b8b6-05f5aec32931 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:52.809915 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1078216f-f731-49dd-b8b6-05f5aec32931 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:52.810857 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1078216f-f731-49dd-b8b6-05f5aec32931 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:52.983378 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1078216f-f731-49dd-b8b6-05f5aec32931 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:52.992080 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-1078216f-f731-49dd-b8b6-05f5aec32931 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.201580 May 19 06:32:52.992679 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 98/203] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:52 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:53.343607 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-60f56af4-16b4-43c2-8b21-29b07fa2d910 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:53.344427 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-60f56af4-16b4-43c2-8b21-29b07fa2d910 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:53.351222 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-60f56af4-16b4-43c2-8b21-29b07fa2d910 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:53.351709 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-60f56af4-16b4-43c2-8b21-29b07fa2d910 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:53.352590 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-60f56af4-16b4-43c2-8b21-29b07fa2d910 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:53.353069 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-60f56af4-16b4-43c2-8b21-29b07fa2d910 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:53.517757 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-60f56af4-16b4-43c2-8b21-29b07fa2d910 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:53.527505 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-60f56af4-16b4-43c2-8b21-29b07fa2d910 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1313 microversion: 2.1 time: 0.187865 May 19 06:32:53.528282 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 106/204] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:53 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:54.010349 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-13f1aead-d8ad-4515-b49d-644c3f17128f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:54.010924 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-13f1aead-d8ad-4515-b49d-644c3f17128f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:54.017829 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-13f1aead-d8ad-4515-b49d-644c3f17128f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:54.018282 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-13f1aead-d8ad-4515-b49d-644c3f17128f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:54.019989 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-13f1aead-d8ad-4515-b49d-644c3f17128f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:54.020437 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-13f1aead-d8ad-4515-b49d-644c3f17128f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:54.198781 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-13f1aead-d8ad-4515-b49d-644c3f17128f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:54.208659 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-13f1aead-d8ad-4515-b49d-644c3f17128f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.202230 May 19 06:32:54.209258 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 99/205] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:54 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:54.545884 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-5a00a503-5075-48f5-9bf4-da3dbd2a4d60 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:54.547152 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-5a00a503-5075-48f5-9bf4-da3dbd2a4d60 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:54.555502 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5a00a503-5075-48f5-9bf4-da3dbd2a4d60 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:54.555927 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5a00a503-5075-48f5-9bf4-da3dbd2a4d60 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:54.556723 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5a00a503-5075-48f5-9bf4-da3dbd2a4d60 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:54.557133 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5a00a503-5075-48f5-9bf4-da3dbd2a4d60 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:54.746560 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-5a00a503-5075-48f5-9bf4-da3dbd2a4d60 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:54.755918 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-5a00a503-5075-48f5-9bf4-da3dbd2a4d60 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1313 microversion: 2.1 time: 0.213908 May 19 06:32:54.756578 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 107/206] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:54 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:55.230715 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5f29dfbe-2d69-4490-855e-dab650b032ce tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:55.231551 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5f29dfbe-2d69-4490-855e-dab650b032ce tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:55.240831 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5f29dfbe-2d69-4490-855e-dab650b032ce tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:55.241598 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5f29dfbe-2d69-4490-855e-dab650b032ce tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:55.242702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5f29dfbe-2d69-4490-855e-dab650b032ce tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:55.243232 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5f29dfbe-2d69-4490-855e-dab650b032ce tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:55.433085 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5f29dfbe-2d69-4490-855e-dab650b032ce tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:55.448411 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5f29dfbe-2d69-4490-855e-dab650b032ce tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.224233 May 19 06:32:55.449427 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 100/207] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:55 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:55.782670 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-65e24015-c03e-4f36-95dc-b1f367e9db5e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:55.783283 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-65e24015-c03e-4f36-95dc-b1f367e9db5e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:55.796796 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-65e24015-c03e-4f36-95dc-b1f367e9db5e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:55.797259 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-65e24015-c03e-4f36-95dc-b1f367e9db5e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:55.798125 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-65e24015-c03e-4f36-95dc-b1f367e9db5e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:55.798564 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-65e24015-c03e-4f36-95dc-b1f367e9db5e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:56.061652 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-65e24015-c03e-4f36-95dc-b1f367e9db5e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:56.075272 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-65e24015-c03e-4f36-95dc-b1f367e9db5e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1313 microversion: 2.1 time: 0.298526 May 19 06:32:56.076494 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 108/208] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:55 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:56.484935 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-af307b79-90a0-4efc-b29c-4bdfdaed1c70 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:56.485850 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-af307b79-90a0-4efc-b29c-4bdfdaed1c70 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:56.493921 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-af307b79-90a0-4efc-b29c-4bdfdaed1c70 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:56.494525 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-af307b79-90a0-4efc-b29c-4bdfdaed1c70 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:56.495524 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-af307b79-90a0-4efc-b29c-4bdfdaed1c70 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:56.496086 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-af307b79-90a0-4efc-b29c-4bdfdaed1c70 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:56.720270 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-af307b79-90a0-4efc-b29c-4bdfdaed1c70 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:56.731377 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-af307b79-90a0-4efc-b29c-4bdfdaed1c70 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.260433 May 19 06:32:56.743815 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 101/209] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:56 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:57.099872 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4df64841-eb75-4e00-a0a8-f67e6282ffea tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:57.100682 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4df64841-eb75-4e00-a0a8-f67e6282ffea tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:57.116065 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4df64841-eb75-4e00-a0a8-f67e6282ffea tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:57.116591 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4df64841-eb75-4e00-a0a8-f67e6282ffea tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:57.117925 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4df64841-eb75-4e00-a0a8-f67e6282ffea tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:57.118485 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4df64841-eb75-4e00-a0a8-f67e6282ffea tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:57.316863 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-4df64841-eb75-4e00-a0a8-f67e6282ffea tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:57.333204 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4df64841-eb75-4e00-a0a8-f67e6282ffea tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1313 microversion: 2.1 time: 0.239923 May 19 06:32:57.345471 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 109/210] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:57 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:57.751817 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d11ab43d-ab0e-45ef-96a7-c5e1dcce9c82 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:57.752667 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d11ab43d-ab0e-45ef-96a7-c5e1dcce9c82 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:57.773649 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d11ab43d-ab0e-45ef-96a7-c5e1dcce9c82 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:57.778691 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d11ab43d-ab0e-45ef-96a7-c5e1dcce9c82 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:57.781153 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d11ab43d-ab0e-45ef-96a7-c5e1dcce9c82 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:57.782969 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d11ab43d-ab0e-45ef-96a7-c5e1dcce9c82 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:57.991720 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d11ab43d-ab0e-45ef-96a7-c5e1dcce9c82 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:58.000165 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d11ab43d-ab0e-45ef-96a7-c5e1dcce9c82 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.252625 May 19 06:32:58.000774 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 102/211] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:57 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:32:58.353977 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e7419952-7514-4059-bcfb-4e2357451901 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:58.354772 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e7419952-7514-4059-bcfb-4e2357451901 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:58.362158 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e7419952-7514-4059-bcfb-4e2357451901 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:58.362845 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e7419952-7514-4059-bcfb-4e2357451901 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:58.364366 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e7419952-7514-4059-bcfb-4e2357451901 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:58.364843 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e7419952-7514-4059-bcfb-4e2357451901 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:58.564528 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e7419952-7514-4059-bcfb-4e2357451901 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:58.573660 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e7419952-7514-4059-bcfb-4e2357451901 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1313 microversion: 2.1 time: 0.224240 May 19 06:32:58.574745 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 110/212] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:58 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:59.019615 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3c6f5827-a660-4690-a6d8-e07d0fb4a4e8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:59.020261 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-3c6f5827-a660-4690-a6d8-e07d0fb4a4e8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:59.027566 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3c6f5827-a660-4690-a6d8-e07d0fb4a4e8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:59.028221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3c6f5827-a660-4690-a6d8-e07d0fb4a4e8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:59.029369 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3c6f5827-a660-4690-a6d8-e07d0fb4a4e8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:59.029860 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3c6f5827-a660-4690-a6d8-e07d0fb4a4e8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:59.033218 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=94,nova_cell1:INSERT=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:32:59.203270 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3c6f5827-a660-4690-a6d8-e07d0fb4a4e8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:59.211914 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-3c6f5827-a660-4690-a6d8-e07d0fb4a4e8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.196474 May 19 06:32:59.212529 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 103/213] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:59 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:32:59.593177 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-40733473-c5fb-483b-ab96-2b87a490f1f3 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:32:59.593928 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-40733473-c5fb-483b-ab96-2b87a490f1f3 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:32:59.600630 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-40733473-c5fb-483b-ab96-2b87a490f1f3 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:59.601074 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-40733473-c5fb-483b-ab96-2b87a490f1f3 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:59.601912 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-40733473-c5fb-483b-ab96-2b87a490f1f3 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:32:59.602341 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-40733473-c5fb-483b-ab96-2b87a490f1f3 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:32:59.767806 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-40733473-c5fb-483b-ab96-2b87a490f1f3 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:32:59.783146 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-40733473-c5fb-483b-ab96-2b87a490f1f3 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1313 microversion: 2.1 time: 0.193526 May 19 06:32:59.784798 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 111/214] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:32:59 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:00.229338 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f04de33a-8d70-4f65-9420-2c7a1916eb89 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:00.229874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f04de33a-8d70-4f65-9420-2c7a1916eb89 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:00.236751 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f04de33a-8d70-4f65-9420-2c7a1916eb89 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:00.237198 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f04de33a-8d70-4f65-9420-2c7a1916eb89 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:00.238529 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f04de33a-8d70-4f65-9420-2c7a1916eb89 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:00.238930 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f04de33a-8d70-4f65-9420-2c7a1916eb89 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:00.390263 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f04de33a-8d70-4f65-9420-2c7a1916eb89 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:00.400130 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f04de33a-8d70-4f65-9420-2c7a1916eb89 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.174462 May 19 06:33:00.400847 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 104/215] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:00 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:00.804104 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-105f87a3-308b-44cd-939b-7e73759b1ded tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:00.804710 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-105f87a3-308b-44cd-939b-7e73759b1ded tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:00.811430 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-105f87a3-308b-44cd-939b-7e73759b1ded tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:00.811875 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-105f87a3-308b-44cd-939b-7e73759b1ded tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:00.812635 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-105f87a3-308b-44cd-939b-7e73759b1ded tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:00.813058 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-105f87a3-308b-44cd-939b-7e73759b1ded tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:00.957674 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-105f87a3-308b-44cd-939b-7e73759b1ded tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:00.965085 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-105f87a3-308b-44cd-939b-7e73759b1ded tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1313 microversion: 2.1 time: 0.165220 May 19 06:33:00.965684 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 112/216] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:00 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:01.419136 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-857960d9-14d5-4211-b626-f7e00de37161 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:01.419848 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-857960d9-14d5-4211-b626-f7e00de37161 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:01.427206 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-857960d9-14d5-4211-b626-f7e00de37161 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:01.427656 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-857960d9-14d5-4211-b626-f7e00de37161 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:01.428433 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-857960d9-14d5-4211-b626-f7e00de37161 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:01.428868 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-857960d9-14d5-4211-b626-f7e00de37161 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:01.583211 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-857960d9-14d5-4211-b626-f7e00de37161 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:01.598480 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-857960d9-14d5-4211-b626-f7e00de37161 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.181707 May 19 06:33:01.599926 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 105/217] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:01 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:01.986352 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0245965b-9cfd-4ca8-b8ed-e8ee7b389c75 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:01.986958 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0245965b-9cfd-4ca8-b8ed-e8ee7b389c75 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:01.995942 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0245965b-9cfd-4ca8-b8ed-e8ee7b389c75 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:01.996399 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0245965b-9cfd-4ca8-b8ed-e8ee7b389c75 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:01.997223 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0245965b-9cfd-4ca8-b8ed-e8ee7b389c75 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:01.997728 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0245965b-9cfd-4ca8-b8ed-e8ee7b389c75 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:02.158568 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0245965b-9cfd-4ca8-b8ed-e8ee7b389c75 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:02.174134 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0245965b-9cfd-4ca8-b8ed-e8ee7b389c75 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1313 microversion: 2.1 time: 0.191668 May 19 06:33:02.175811 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 113/218] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:01 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:02.626529 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b45f9423-68f3-4268-a2c5-b06b1b46c52c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:02.627683 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b45f9423-68f3-4268-a2c5-b06b1b46c52c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:02.637239 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b45f9423-68f3-4268-a2c5-b06b1b46c52c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:02.637800 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b45f9423-68f3-4268-a2c5-b06b1b46c52c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:02.638802 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b45f9423-68f3-4268-a2c5-b06b1b46c52c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:02.639390 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b45f9423-68f3-4268-a2c5-b06b1b46c52c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:02.804771 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b45f9423-68f3-4268-a2c5-b06b1b46c52c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:02.812549 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b45f9423-68f3-4268-a2c5-b06b1b46c52c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.192486 May 19 06:33:02.813140 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 106/219] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:02 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:03.193471 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-cb30d203-fa4c-44e3-a17c-c6c529a6fe7e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:03.194374 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-cb30d203-fa4c-44e3-a17c-c6c529a6fe7e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:03.200609 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cb30d203-fa4c-44e3-a17c-c6c529a6fe7e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:03.201046 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cb30d203-fa4c-44e3-a17c-c6c529a6fe7e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:03.201859 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cb30d203-fa4c-44e3-a17c-c6c529a6fe7e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:03.202294 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cb30d203-fa4c-44e3-a17c-c6c529a6fe7e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:03.205394 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=100 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:33:03.372582 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-cb30d203-fa4c-44e3-a17c-c6c529a6fe7e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:03.381721 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-cb30d203-fa4c-44e3-a17c-c6c529a6fe7e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1497 microversion: 2.1 time: 0.193099 May 19 06:33:03.382335 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 114/220] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:03 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1497 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:33:03.834439 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f16b8687-8a76-476b-ba20-e04b1c30fae6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:03.835904 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f16b8687-8a76-476b-ba20-e04b1c30fae6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:03.843654 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f16b8687-8a76-476b-ba20-e04b1c30fae6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:03.844538 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f16b8687-8a76-476b-ba20-e04b1c30fae6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:03.846203 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f16b8687-8a76-476b-ba20-e04b1c30fae6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:03.846710 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f16b8687-8a76-476b-ba20-e04b1c30fae6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:03.905016 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2f168d74-0f52-4bd7-988d-554ce8bc902b tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:03.906232 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-2f168d74-0f52-4bd7-988d-554ce8bc902b tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:03.927358 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2f168d74-0f52-4bd7-988d-554ce8bc902b tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:03.928973 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2f168d74-0f52-4bd7-988d-554ce8bc902b tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:03.931846 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2f168d74-0f52-4bd7-988d-554ce8bc902b tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:03.932568 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2f168d74-0f52-4bd7-988d-554ce8bc902b tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:04.013553 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-2f168d74-0f52-4bd7-988d-554ce8bc902b tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Going to try to terminate instance {{(pid=117712) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 06:33:04.188442 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2f168d74-0f52-4bd7-988d-554ce8bc902b tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 204 len: 0 microversion: 2.1 time: 0.290160 May 19 06:33:04.192002 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 115/221] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 06:33:03 2022] DELETE /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 06:33:04.207678 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a41fe099-36ca-4105-93bc-4d427604529d tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1898576764", "imageRef": "27959167-098e-44c5-ba0a-e9fb8054c377", "flavorRef": "452"}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:33:04.233442 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f16b8687-8a76-476b-ba20-e04b1c30fae6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:04.250490 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f16b8687-8a76-476b-ba20-e04b1c30fae6 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.421505 May 19 06:33:04.261847 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 107/222] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:03 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:04.266962 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-45fcd7a1-629d-47a5-a773-7085821017e3 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:04.267583 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-45fcd7a1-629d-47a5-a773-7085821017e3 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:04.276435 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-45fcd7a1-629d-47a5-a773-7085821017e3 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:04.276936 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-45fcd7a1-629d-47a5-a773-7085821017e3 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:04.277713 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-45fcd7a1-629d-47a5-a773-7085821017e3 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:04.278353 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-45fcd7a1-629d-47a5-a773-7085821017e3 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:04.302291 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.network.neutron [None req-a41fe099-36ca-4105-93bc-4d427604529d tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] validate_networks() for None {{(pid=117712) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 06:33:04.454408 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-45fcd7a1-629d-47a5-a773-7085821017e3 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:04.465411 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-45fcd7a1-629d-47a5-a773-7085821017e3 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1503 microversion: 2.1 time: 0.202287 May 19 06:33:04.466121 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 108/223] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:04 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1503 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:04.733340 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-a41fe099-36ca-4105-93bc-4d427604529d tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Flavor limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 06:33:04.733773 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-a41fe099-36ca-4105-93bc-4d427604529d tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Image limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 06:33:04.734248 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-a41fe099-36ca-4105-93bc-4d427604529d tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Flavor pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 06:33:04.734656 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-a41fe099-36ca-4105-93bc-4d427604529d tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Image pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 06:33:04.735072 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-a41fe099-36ca-4105-93bc-4d427604529d tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 06:33:04.748462 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a41fe099-36ca-4105-93bc-4d427604529d tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:04.749726 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a41fe099-36ca-4105-93bc-4d427604529d tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:04.751143 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a41fe099-36ca-4105-93bc-4d427604529d tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:04.751590 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a41fe099-36ca-4105-93bc-4d427604529d tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:04.773941 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-a41fe099-36ca-4105-93bc-4d427604529d tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Getting quotas for project 8beaccf2315245ec8959a58d23ebd293. Resources: {'ram', 'cores', 'instances'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:33:04.779190 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-a41fe099-36ca-4105-93bc-4d427604529d tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Getting quotas for user b4d720bb1f5c4336a394c413d9d1c612 and project 8beaccf2315245ec8959a58d23ebd293. Resources: {'ram', 'cores', 'instances'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:33:04.806969 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a41fe099-36ca-4105-93bc-4d427604529d tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Going to run 1 instances... {{(pid=117712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 06:33:04.809613 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a41fe099-36ca-4105-93bc-4d427604529d tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] [instance: d5d1dc9d-8cc9-48b5-b7ec-34535b051b30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27959167-098e-44c5-ba0a-e9fb8054c377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 06:33:04.863280 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a41fe099-36ca-4105-93bc-4d427604529d tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.668645 May 19 06:33:04.864136 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 116/224] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 06:33:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 06:33:04.878190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ccd73763-84e4-4bca-8925-b53be03d8575 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:04.879212 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ccd73763-84e4-4bca-8925-b53be03d8575 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] [instance: d5d1dc9d-8cc9-48b5-b7ec-34535b051b30] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:04.960126 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ccd73763-84e4-4bca-8925-b53be03d8575 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d720bb1f5c4336a394c413d9d1c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beaccf2315245ec8959a58d23ebd293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:04.967580 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ccd73763-84e4-4bca-8925-b53be03d8575 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] 10.222.0.65 "GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30" status: 200 len: 1215 microversion: 2.1 time: 0.093694 May 19 06:33:04.978658 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 109/225] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:04 2022] GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:05.268056 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-fca96f7d-8bb4-4e03-a803-31dbdbc7128d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:05.269887 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-fca96f7d-8bb4-4e03-a803-31dbdbc7128d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:05.277186 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fca96f7d-8bb4-4e03-a803-31dbdbc7128d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:05.278195 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fca96f7d-8bb4-4e03-a803-31dbdbc7128d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:05.279221 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fca96f7d-8bb4-4e03-a803-31dbdbc7128d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:05.279833 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fca96f7d-8bb4-4e03-a803-31dbdbc7128d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:05.460992 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-fca96f7d-8bb4-4e03-a803-31dbdbc7128d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:05.463352 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-fca96f7d-8bb4-4e03-a803-31dbdbc7128d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.199107 May 19 06:33:05.463966 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 117/226] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:05 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:05.482588 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0701c61a-d2cb-43a7-9103-6c66d1967ecd tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:05.483201 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0701c61a-d2cb-43a7-9103-6c66d1967ecd tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:05.491508 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0701c61a-d2cb-43a7-9103-6c66d1967ecd tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:05.491949 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0701c61a-d2cb-43a7-9103-6c66d1967ecd tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:05.492902 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0701c61a-d2cb-43a7-9103-6c66d1967ecd tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:05.493572 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0701c61a-d2cb-43a7-9103-6c66d1967ecd tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:05.648503 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0701c61a-d2cb-43a7-9103-6c66d1967ecd tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:05.656840 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0701c61a-d2cb-43a7-9103-6c66d1967ecd tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1503 microversion: 2.1 time: 0.178125 May 19 06:33:05.657479 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 110/227] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:05 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1503 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:05.986120 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f851b5a0-0c2a-4e2e-aa9c-c280f485d78c tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:05.986743 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f851b5a0-0c2a-4e2e-aa9c-c280f485d78c tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] [instance: d5d1dc9d-8cc9-48b5-b7ec-34535b051b30] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:05.995830 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f851b5a0-0c2a-4e2e-aa9c-c280f485d78c tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:05.996504 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f851b5a0-0c2a-4e2e-aa9c-c280f485d78c tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:05.997762 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f851b5a0-0c2a-4e2e-aa9c-c280f485d78c tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:05.998574 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f851b5a0-0c2a-4e2e-aa9c-c280f485d78c tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:06.110413 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f851b5a0-0c2a-4e2e-aa9c-c280f485d78c tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d720bb1f5c4336a394c413d9d1c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beaccf2315245ec8959a58d23ebd293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:06.123004 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f851b5a0-0c2a-4e2e-aa9c-c280f485d78c tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] 10.222.0.65 "GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30" status: 200 len: 1211 microversion: 2.1 time: 0.140641 May 19 06:33:06.124127 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 118/228] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:05 2022] GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 => generated 1211 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:06.499052 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ca1dea44-dce0-47be-9223-1189776866f8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:06.501212 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ca1dea44-dce0-47be-9223-1189776866f8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:06.511580 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ca1dea44-dce0-47be-9223-1189776866f8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:06.512430 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ca1dea44-dce0-47be-9223-1189776866f8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:06.513617 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ca1dea44-dce0-47be-9223-1189776866f8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:06.514454 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ca1dea44-dce0-47be-9223-1189776866f8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:06.528995 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-910720cf-dd0a-4282-b93d-b96f156975ac req-f1a6c45d-949d-4560-8b02-eeb0bd131690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17c90e2-1f91-492e-ae74-56e09b7b73fc", "name": "network-vif-deleted", "tag": "886112b1-affd-4a9c-b3b1-64b34b4fb264"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:33:06.546237 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-910720cf-dd0a-4282-b93d-b96f156975ac req-f1a6c45d-949d-4560-8b02-eeb0bd131690 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:06.550717 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-910720cf-dd0a-4282-b93d-b96f156975ac req-f1a6c45d-949d-4560-8b02-eeb0bd131690 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:06.581993 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-910720cf-dd0a-4282-b93d-b96f156975ac req-f1a6c45d-949d-4560-8b02-eeb0bd131690 service nova] Creating event network-vif-deleted:886112b1-affd-4a9c-b3b1-64b34b4fb264 for instance a17c90e2-1f91-492e-ae74-56e09b7b73fc on hv-cinder-83699 May 19 06:33:06.598045 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-910720cf-dd0a-4282-b93d-b96f156975ac req-f1a6c45d-949d-4560-8b02-eeb0bd131690 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070633 May 19 06:33:06.598836 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 119/229] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:33:06.677730 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-932916d6-1249-4497-95a3-7ea9ea5ed0a6 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:06.678682 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-932916d6-1249-4497-95a3-7ea9ea5ed0a6 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:06.695297 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-932916d6-1249-4497-95a3-7ea9ea5ed0a6 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:06.698148 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-932916d6-1249-4497-95a3-7ea9ea5ed0a6 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:06.701355 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-932916d6-1249-4497-95a3-7ea9ea5ed0a6 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:06.702092 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-932916d6-1249-4497-95a3-7ea9ea5ed0a6 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:06.747649 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ca1dea44-dce0-47be-9223-1189776866f8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:06.764184 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ca1dea44-dce0-47be-9223-1189776866f8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.272405 May 19 06:33:06.767240 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 111/230] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:06 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:06.867790 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-932916d6-1249-4497-95a3-7ea9ea5ed0a6 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:06.875933 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-932916d6-1249-4497-95a3-7ea9ea5ed0a6 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 200 len: 1298 microversion: 2.1 time: 0.204392 May 19 06:33:06.876698 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 120/231] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:06 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 1298 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:33:07.039007 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-daabafbb-2a28-40c9-8dae-6865d88cf9fc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Action: 'create', calling method: .version_select at 0x7f9aeb7d5d30>, body: {"keypair": {"name": "tempest-keypair-1444113227", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlGne3dSmm+b8InWSD8GLo1mI6HcKbVSjXkmFSJP3lEynyZntxHHiZO9zxufYHplCzS0Vx9QPwxUqF//SpiaqrmPORstU2JZgDmmOb7rtAsActzVUr5L0y6JU/RNbartg=="}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:33:07.056906 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-daabafbb-2a28-40c9-8dae-6865d88cf9fc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Getting quotas for project adbcff8654844c22a906a2e91ebca3bb. Resources: {'key_pairs'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:33:07.062068 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-daabafbb-2a28-40c9-8dae-6865d88cf9fc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Getting quotas for user cb2bf8531dfe42b29b0b632b39d49625 and project adbcff8654844c22a906a2e91ebca3bb. Resources: {'key_pairs'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:33:07.097666 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-daabafbb-2a28-40c9-8dae-6865d88cf9fc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.063901 May 19 06:33:07.098277 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 112/232] 10.222.0.65 () {60 vars in 1158 bytes} [Thu May 19 06:33:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:33:07.143569 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-460d9d64-eccd-4641-a67a-4d7010db28ae tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:07.145156 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-460d9d64-eccd-4641-a67a-4d7010db28ae tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] [instance: d5d1dc9d-8cc9-48b5-b7ec-34535b051b30] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:07.157037 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-460d9d64-eccd-4641-a67a-4d7010db28ae tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:07.158113 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-460d9d64-eccd-4641-a67a-4d7010db28ae tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:07.159423 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-460d9d64-eccd-4641-a67a-4d7010db28ae tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:07.160075 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-460d9d64-eccd-4641-a67a-4d7010db28ae tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:07.283561 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-460d9d64-eccd-4641-a67a-4d7010db28ae tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d720bb1f5c4336a394c413d9d1c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beaccf2315245ec8959a58d23ebd293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:07.293948 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-460d9d64-eccd-4641-a67a-4d7010db28ae tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] 10.222.0.65 "GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30" status: 200 len: 1273 microversion: 2.1 time: 0.156346 May 19 06:33:07.295014 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 121/233] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:07 2022] GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 => generated 1273 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:07.785425 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-da204920-4a4f-4a53-bce4-a57ae11aec8d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:07.786687 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-da204920-4a4f-4a53-bce4-a57ae11aec8d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:07.794040 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-da204920-4a4f-4a53-bce4-a57ae11aec8d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:07.794804 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-da204920-4a4f-4a53-bce4-a57ae11aec8d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:07.797160 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-da204920-4a4f-4a53-bce4-a57ae11aec8d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:07.797850 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-da204920-4a4f-4a53-bce4-a57ae11aec8d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:07.896997 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f0e7accf-4df7-4172-a9ca-fd990008f316 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:07.898374 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f0e7accf-4df7-4172-a9ca-fd990008f316 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: a17c90e2-1f91-492e-ae74-56e09b7b73fc] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:07.910124 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f0e7accf-4df7-4172-a9ca-fd990008f316 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:07.910783 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f0e7accf-4df7-4172-a9ca-fd990008f316 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:07.911711 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f0e7accf-4df7-4172-a9ca-fd990008f316 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:07.913816 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f0e7accf-4df7-4172-a9ca-fd990008f316 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:07.947954 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-f0e7accf-4df7-4172-a9ca-fd990008f316 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] HTTP exception thrown: Instance a17c90e2-1f91-492e-ae74-56e09b7b73fc could not be found. May 19 06:33:07.950954 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f0e7accf-4df7-4172-a9ca-fd990008f316 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Request method failure captured: May 19 06:33:07.950954 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc HTTP/1.1 May 19 06:33:07.950954 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept: application/json May 19 06:33:07.950954 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity May 19 06:33:07.950954 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Connection: close May 19 06:33:07.950954 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Length: 0 May 19 06:33:07.950954 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Type: application/json May 19 06:33:07.950954 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Host: 10.222.0.65 May 19 06:33:07.950954 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None May 19 06:33:07.950954 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 May 19 06:33:07.950954 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiheR3w656dmNgLi9hZ0z-KvXs9zaqte7jd4p3h6onl1is7LI3_dQzVBK0__p5mtTGf95qz7YJONd8H5njuHv67vc3O4RaVG2a8IbMP_-X_KzfTcdYcyTamiQn6oYUCAJ7gclIyI3S_okuo4Jy989VATmm353xr8MnBYLj7-MyBxnjcKo May 19 06:33:07.950954 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Id: None May 19 06:33:07.950954 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Name: None May 19 06:33:07.950954 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed May 19 06:33:07.950954 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True May 19 06:33:07.950954 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default May 19 06:33:07.950954 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default May 19 06:33:07.950954 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Id: af231f2d98544631857757d5b48fd918 May 19 06:33:07.950954 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-VolumesActionsTest-572450892 May 19 06:33:07.950954 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Role: reader,member May 19 06:33:07.950954 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Roles: reader,member May 19 06:33:07.952470 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/af231f2d98544631857757d5b48fd918"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/af231f2d98544631857757d5b48fd918"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/af231f2d98544631857757d5b48fd918"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_af231f2d98544631857757d5b48fd918", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:33:07.952470 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-VolumesActionsTest-572450892 May 19 06:33:07.952470 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Id: af231f2d98544631857757d5b48fd918 May 19 06:33:07.952470 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-VolumesActionsTest-572450892 May 19 06:33:07.952470 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User: tempest-VolumesActionsTest-572450892-project May 19 06:33:07.952470 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default May 19 06:33:07.952470 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default May 19 06:33:07.952470 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Id: ce2c7ead49a047c6bc04a783ed0bfc43 May 19 06:33:07.952470 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-VolumesActionsTest-572450892-project May 19 06:33:07.952470 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: method: > May 19 06:33:07.952470 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: exception: Instance a17c90e2-1f91-492e-ae74-56e09b7b73fc could not be found. May 19 06:33:07.952470 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: action_args: {'id': 'a17c90e2-1f91-492e-ae74-56e09b7b73fc'} May 19 06:33:07.953159 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:33:07.953159 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:33:07.953159 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:33:07.953159 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:33:07.953159 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:33:07.953159 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:33:07.953159 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:33:07.953159 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:33:07.953159 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:33:07.953159 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:33:07.953159 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a17c90e2-1f91-492e-ae74-56e09b7b73fc could not be found. May 19 06:33:07.953159 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:33:07.953159 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:33:07.953159 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:33:07.953159 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:33:07.953159 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:33:07.953159 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:33:07.953159 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:33:07.953159 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:33:07.953159 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:33:07.954306 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:33:07.954306 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:33:07.954306 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:33:07.954306 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:33:07.954306 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:33:07.954306 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:33:07.954306 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:33:07.954306 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a17c90e2-1f91-492e-ae74-56e09b7b73fc could not be found. May 19 06:33:07.954306 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:33:07.954306 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:33:07.954306 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:33:07.954306 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:33:07.954306 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:33:07.954306 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:33:07.954306 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:33:07.954306 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:33:07.954306 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a17c90e2-1f91-492e-ae74-56e09b7b73fc could not be found. May 19 06:33:07.954306 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:33:07.957237 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f0e7accf-4df7-4172-a9ca-fd990008f316 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Returning 404 to user: Instance a17c90e2-1f91-492e-ae74-56e09b7b73fc could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:33:07.958223 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f0e7accf-4df7-4172-a9ca-fd990008f316 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc" status: 404 len: 111 microversion: 2.1 time: 0.066186 May 19 06:33:07.958962 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 122/234] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:07 2022] GET /compute/v2.1/servers/a17c90e2-1f91-492e-ae74-56e09b7b73fc => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:33:08.040350 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-da204920-4a4f-4a53-bce4-a57ae11aec8d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:08.050965 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-da204920-4a4f-4a53-bce4-a57ae11aec8d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.270557 May 19 06:33:08.052221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 113/235] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:07 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:08.191626 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4174e6bb-e95a-4c69-9599-c2288a0d61d8 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1871282342", "imageRef": "27959167-098e-44c5-ba0a-e9fb8054c377", "flavorRef": "452", "networks": [{"uuid": "a8a787e6-32b8-4da9-92d6-017ec62447d1"}]}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:33:08.260105 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.network.neutron [None req-4174e6bb-e95a-4c69-9599-c2288a0d61d8 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] validate_networks() for [('a8a787e6-32b8-4da9-92d6-017ec62447d1', None, None, None, None, None)] {{(pid=117712) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 06:33:08.311882 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-758665a5-3c09-44d6-8ab1-b19c989b412c tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:08.312498 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-758665a5-3c09-44d6-8ab1-b19c989b412c tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] [instance: d5d1dc9d-8cc9-48b5-b7ec-34535b051b30] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:08.324826 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-758665a5-3c09-44d6-8ab1-b19c989b412c tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:08.325011 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-758665a5-3c09-44d6-8ab1-b19c989b412c tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:08.325875 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-758665a5-3c09-44d6-8ab1-b19c989b412c tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:08.326478 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-758665a5-3c09-44d6-8ab1-b19c989b412c tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:08.486649 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-758665a5-3c09-44d6-8ab1-b19c989b412c tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d720bb1f5c4336a394c413d9d1c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beaccf2315245ec8959a58d23ebd293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:08.495236 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-758665a5-3c09-44d6-8ab1-b19c989b412c tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] 10.222.0.65 "GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30" status: 200 len: 1315 microversion: 2.1 time: 0.187214 May 19 06:33:08.495855 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 114/236] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:08 2022] GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:33:09.078194 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-fda94f9a-24f6-485b-9ed9-5f08bdcea9a3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:09.079695 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-fda94f9a-24f6-485b-9ed9-5f08bdcea9a3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:09.086161 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fda94f9a-24f6-485b-9ed9-5f08bdcea9a3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:09.087121 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fda94f9a-24f6-485b-9ed9-5f08bdcea9a3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:09.087913 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fda94f9a-24f6-485b-9ed9-5f08bdcea9a3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:09.088344 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fda94f9a-24f6-485b-9ed9-5f08bdcea9a3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:09.284794 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-fda94f9a-24f6-485b-9ed9-5f08bdcea9a3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:09.294768 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-fda94f9a-24f6-485b-9ed9-5f08bdcea9a3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.221032 May 19 06:33:09.295670 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 115/237] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:09 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:33:09.497778 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-4174e6bb-e95a-4c69-9599-c2288a0d61d8 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Flavor limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 06:33:09.498278 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-4174e6bb-e95a-4c69-9599-c2288a0d61d8 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Image limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 06:33:09.498655 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-4174e6bb-e95a-4c69-9599-c2288a0d61d8 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Flavor pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 06:33:09.499247 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-4174e6bb-e95a-4c69-9599-c2288a0d61d8 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Image pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 06:33:09.499664 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-4174e6bb-e95a-4c69-9599-c2288a0d61d8 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 06:33:09.514683 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-cffbb722-28a3-4efd-bca0-9bb6d9d9556e tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:09.515821 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-cffbb722-28a3-4efd-bca0-9bb6d9d9556e tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] [instance: d5d1dc9d-8cc9-48b5-b7ec-34535b051b30] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:09.519766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4174e6bb-e95a-4c69-9599-c2288a0d61d8 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:09.520597 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4174e6bb-e95a-4c69-9599-c2288a0d61d8 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:09.522367 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4174e6bb-e95a-4c69-9599-c2288a0d61d8 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:09.523696 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cffbb722-28a3-4efd-bca0-9bb6d9d9556e tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:09.524502 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4174e6bb-e95a-4c69-9599-c2288a0d61d8 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:09.524927 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cffbb722-28a3-4efd-bca0-9bb6d9d9556e tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:09.525922 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cffbb722-28a3-4efd-bca0-9bb6d9d9556e tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:09.526531 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cffbb722-28a3-4efd-bca0-9bb6d9d9556e tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:09.554068 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-4174e6bb-e95a-4c69-9599-c2288a0d61d8 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Getting quotas for project af231f2d98544631857757d5b48fd918. Resources: {'ram', 'cores', 'instances'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:33:09.559324 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-4174e6bb-e95a-4c69-9599-c2288a0d61d8 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Getting quotas for user ce2c7ead49a047c6bc04a783ed0bfc43 and project af231f2d98544631857757d5b48fd918. Resources: {'ram', 'cores', 'instances'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:33:09.576302 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4174e6bb-e95a-4c69-9599-c2288a0d61d8 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Going to run 1 instances... {{(pid=117712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 06:33:09.579195 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4174e6bb-e95a-4c69-9599-c2288a0d61d8 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: 32ec744c-95d9-4999-a7fe-8c884dfe1a05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27959167-098e-44c5-ba0a-e9fb8054c377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 06:33:09.646692 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4174e6bb-e95a-4c69-9599-c2288a0d61d8 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.459680 May 19 06:33:09.647321 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 123/238] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 06:33:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 06:33:09.658812 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3e139057-8e23-458d-873e-63b9904067c6 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:09.660244 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3e139057-8e23-458d-873e-63b9904067c6 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: 32ec744c-95d9-4999-a7fe-8c884dfe1a05] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:09.749535 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3e139057-8e23-458d-873e-63b9904067c6 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:09.760155 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3e139057-8e23-458d-873e-63b9904067c6 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05" status: 200 len: 1214 microversion: 2.1 time: 0.105139 May 19 06:33:09.762648 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 124/239] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:09 2022] GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05 => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:33:09.915995 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-a455bd9f-f6a0-4581-af1e-c4bfd3ba34d2 req-b2266cf9-a398-4e0b-a257-93a3326a2300 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d1dc9d-8cc9-48b5-b7ec-34535b051b30", "tag": "58286b94-de20-44e2-b14e-60bc473bc84e"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:33:09.934412 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-cffbb722-28a3-4efd-bca0-9bb6d9d9556e tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d720bb1f5c4336a394c413d9d1c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beaccf2315245ec8959a58d23ebd293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:09.952369 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-cffbb722-28a3-4efd-bca0-9bb6d9d9556e tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] 10.222.0.65 "GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30" status: 200 len: 1315 microversion: 2.1 time: 0.439857 May 19 06:33:09.953585 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 116/240] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:09 2022] GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:09.985824 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-a455bd9f-f6a0-4581-af1e-c4bfd3ba34d2 req-b2266cf9-a398-4e0b-a257-93a3326a2300 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:09.987876 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-a455bd9f-f6a0-4581-af1e-c4bfd3ba34d2 req-b2266cf9-a398-4e0b-a257-93a3326a2300 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:10.033770 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-a455bd9f-f6a0-4581-af1e-c4bfd3ba34d2 req-b2266cf9-a398-4e0b-a257-93a3326a2300 service nova] Creating event network-changed:58286b94-de20-44e2-b14e-60bc473bc84e for instance d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 on hv-cinder-83699 May 19 06:33:10.046368 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-a455bd9f-f6a0-4581-af1e-c4bfd3ba34d2 req-b2266cf9-a398-4e0b-a257-93a3326a2300 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137578 May 19 06:33:10.047160 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 125/241] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:33:10.101636 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e2a34d70-eaee-4c32-9a59-8947b87c4c92 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:10.102904 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e2a34d70-eaee-4c32-9a59-8947b87c4c92 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:10.131402 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e2a34d70-eaee-4c32-9a59-8947b87c4c92 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:10.134974 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e2a34d70-eaee-4c32-9a59-8947b87c4c92 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:10.135996 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e2a34d70-eaee-4c32-9a59-8947b87c4c92 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:10.137425 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e2a34d70-eaee-4c32-9a59-8947b87c4c92 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:10.205252 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e2a34d70-eaee-4c32-9a59-8947b87c4c92 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac/ips" status: 200 len: 147 microversion: 2.1 time: 0.117210 May 19 06:33:10.206994 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 117/242] 10.222.0.65 () {58 vars in 1247 bytes} [Thu May 19 06:33:10 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac/ips => generated 147 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:33:10.317308 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-61bdd8e8-d437-446f-8cc1-26d5c528d646 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:10.323924 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-61bdd8e8-d437-446f-8cc1-26d5c528d646 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:10.345870 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-61bdd8e8-d437-446f-8cc1-26d5c528d646 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:10.347838 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-61bdd8e8-d437-446f-8cc1-26d5c528d646 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:10.348998 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-61bdd8e8-d437-446f-8cc1-26d5c528d646 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:10.350490 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-61bdd8e8-d437-446f-8cc1-26d5c528d646 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:10.692979 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-61bdd8e8-d437-446f-8cc1-26d5c528d646 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:10.701548 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-61bdd8e8-d437-446f-8cc1-26d5c528d646 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.391087 May 19 06:33:10.714209 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 126/243] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:10 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:10.779245 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-84814e99-94be-4a16-aa3e-6692cd2bc7cc tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:10.780039 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-84814e99-94be-4a16-aa3e-6692cd2bc7cc tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: 32ec744c-95d9-4999-a7fe-8c884dfe1a05] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:10.792060 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-84814e99-94be-4a16-aa3e-6692cd2bc7cc tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:10.793929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-84814e99-94be-4a16-aa3e-6692cd2bc7cc tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:10.795622 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-84814e99-94be-4a16-aa3e-6692cd2bc7cc tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:10.796903 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-84814e99-94be-4a16-aa3e-6692cd2bc7cc tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:10.813641 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c7e78093-50f8-4881-95a0-05d3312b3792 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1651027145", "imageRef": "27959167-098e-44c5-ba0a-e9fb8054c377", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ba03612d-d3e3-499d-b899-41fd0fc8db5e"}], "security_groups": [{"name": "tempest-securitygroup--283918548"}], "key_name": "tempest-keypair-1444113227", "user_data": "}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:33:10.892591 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-84814e99-94be-4a16-aa3e-6692cd2bc7cc tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:10.905661 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-84814e99-94be-4a16-aa3e-6692cd2bc7cc tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05" status: 200 len: 1210 microversion: 2.1 time: 0.131936 May 19 06:33:10.906916 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 118/244] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:10 2022] GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05 => generated 1210 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:33:10.958333 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.network.neutron [None req-c7e78093-50f8-4881-95a0-05d3312b3792 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] validate_networks() for [('ba03612d-d3e3-499d-b899-41fd0fc8db5e', None, None, None, None, None)] {{(pid=117712) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 06:33:10.980311 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-bbb5eab4-87c7-4453-ac05-5c0bcafa92ec tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:10.980311 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-bbb5eab4-87c7-4453-ac05-5c0bcafa92ec tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] [instance: d5d1dc9d-8cc9-48b5-b7ec-34535b051b30] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:10.985506 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bbb5eab4-87c7-4453-ac05-5c0bcafa92ec tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:10.985963 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bbb5eab4-87c7-4453-ac05-5c0bcafa92ec tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:10.986746 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bbb5eab4-87c7-4453-ac05-5c0bcafa92ec tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:10.988082 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bbb5eab4-87c7-4453-ac05-5c0bcafa92ec tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:11.149393 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-bbb5eab4-87c7-4453-ac05-5c0bcafa92ec tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d720bb1f5c4336a394c413d9d1c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beaccf2315245ec8959a58d23ebd293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:11.160003 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-bbb5eab4-87c7-4453-ac05-5c0bcafa92ec tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] 10.222.0.65 "GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30" status: 200 len: 1315 microversion: 2.1 time: 0.187457 May 19 06:33:11.160894 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 119/245] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:10 2022] GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:11.201600 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:33:11.461180 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-c7e78093-50f8-4881-95a0-05d3312b3792 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Flavor limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 06:33:11.461755 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-c7e78093-50f8-4881-95a0-05d3312b3792 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Image limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 06:33:11.462413 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-c7e78093-50f8-4881-95a0-05d3312b3792 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Flavor pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 06:33:11.462952 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-c7e78093-50f8-4881-95a0-05d3312b3792 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Image pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 06:33:11.463644 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-c7e78093-50f8-4881-95a0-05d3312b3792 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 06:33:11.473743 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c7e78093-50f8-4881-95a0-05d3312b3792 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:11.474270 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c7e78093-50f8-4881-95a0-05d3312b3792 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:11.475151 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c7e78093-50f8-4881-95a0-05d3312b3792 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:11.475728 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c7e78093-50f8-4881-95a0-05d3312b3792 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:11.494655 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-c7e78093-50f8-4881-95a0-05d3312b3792 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Getting quotas for project adbcff8654844c22a906a2e91ebca3bb. Resources: {'ram', 'cores', 'instances'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:33:11.499157 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-c7e78093-50f8-4881-95a0-05d3312b3792 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Getting quotas for user cb2bf8531dfe42b29b0b632b39d49625 and project adbcff8654844c22a906a2e91ebca3bb. Resources: {'ram', 'cores', 'instances'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:33:11.513566 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c7e78093-50f8-4881-95a0-05d3312b3792 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Going to run 1 instances... {{(pid=117712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 06:33:11.516193 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c7e78093-50f8-4881-95a0-05d3312b3792 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27959167-098e-44c5-ba0a-e9fb8054c377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 06:33:11.586148 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c7e78093-50f8-4881-95a0-05d3312b3792 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.776496 May 19 06:33:11.589643 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 127/246] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 06:33:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 06:33:11.598408 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-627f4047-b449-48f6-8615-6f70d784917f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:11.599198 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-627f4047-b449-48f6-8615-6f70d784917f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:11.601722 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:33:11.691061 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-627f4047-b449-48f6-8615-6f70d784917f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:11.698918 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-627f4047-b449-48f6-8615-6f70d784917f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd" status: 200 len: 1242 microversion: 2.1 time: 0.105824 May 19 06:33:11.699618 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 120/247] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:11 2022] GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd => generated 1242 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:11.727821 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2b5a1d96-9d2b-4746-9503-ad4bccd1ff54 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:11.728515 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-2b5a1d96-9d2b-4746-9503-ad4bccd1ff54 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:11.735688 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2b5a1d96-9d2b-4746-9503-ad4bccd1ff54 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:11.736175 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2b5a1d96-9d2b-4746-9503-ad4bccd1ff54 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:11.737115 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2b5a1d96-9d2b-4746-9503-ad4bccd1ff54 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:11.738373 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2b5a1d96-9d2b-4746-9503-ad4bccd1ff54 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:11.926011 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e14d8825-2cce-4b1b-96de-96d2bb4c59df tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:11.927241 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e14d8825-2cce-4b1b-96de-96d2bb4c59df tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: 32ec744c-95d9-4999-a7fe-8c884dfe1a05] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:11.929462 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-2b5a1d96-9d2b-4746-9503-ad4bccd1ff54 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:11.933827 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e14d8825-2cce-4b1b-96de-96d2bb4c59df tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:11.934477 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e14d8825-2cce-4b1b-96de-96d2bb4c59df tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:11.935576 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e14d8825-2cce-4b1b-96de-96d2bb4c59df tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:11.936161 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e14d8825-2cce-4b1b-96de-96d2bb4c59df tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:11.939084 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2b5a1d96-9d2b-4746-9503-ad4bccd1ff54 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.215342 May 19 06:33:11.939797 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 128/248] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:11 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:12.022677 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e14d8825-2cce-4b1b-96de-96d2bb4c59df tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:12.033507 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e14d8825-2cce-4b1b-96de-96d2bb4c59df tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05" status: 200 len: 1210 microversion: 2.1 time: 0.111564 May 19 06:33:12.033507 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 121/249] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:11 2022] GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05 => generated 1210 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:12.178394 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-116280d3-eb36-421c-8a28-b37a0d9b36d2 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:12.179023 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-116280d3-eb36-421c-8a28-b37a0d9b36d2 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] [instance: d5d1dc9d-8cc9-48b5-b7ec-34535b051b30] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:12.185749 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-116280d3-eb36-421c-8a28-b37a0d9b36d2 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:12.186200 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-116280d3-eb36-421c-8a28-b37a0d9b36d2 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:12.186981 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-116280d3-eb36-421c-8a28-b37a0d9b36d2 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:12.187413 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-116280d3-eb36-421c-8a28-b37a0d9b36d2 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:12.319598 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-116280d3-eb36-421c-8a28-b37a0d9b36d2 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d720bb1f5c4336a394c413d9d1c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beaccf2315245ec8959a58d23ebd293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:12.327150 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-116280d3-eb36-421c-8a28-b37a0d9b36d2 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] 10.222.0.65 "GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30" status: 200 len: 1315 microversion: 2.1 time: 0.153638 May 19 06:33:12.327727 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 129/250] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:12 2022] GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:12.716109 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5d04771c-89e4-464e-888e-92147d55f222 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:12.716712 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5d04771c-89e4-464e-888e-92147d55f222 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:12.723539 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5d04771c-89e4-464e-888e-92147d55f222 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:12.723982 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5d04771c-89e4-464e-888e-92147d55f222 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:12.724739 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5d04771c-89e4-464e-888e-92147d55f222 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:12.725164 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5d04771c-89e4-464e-888e-92147d55f222 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:12.792270 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5d04771c-89e4-464e-888e-92147d55f222 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:12.799804 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5d04771c-89e4-464e-888e-92147d55f222 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd" status: 200 len: 1246 microversion: 2.1 time: 0.087555 May 19 06:33:12.800430 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 122/251] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:12 2022] GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:12.963453 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ab262363-883b-4f1a-84d4-fe431f641867 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:12.964092 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ab262363-883b-4f1a-84d4-fe431f641867 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:12.970173 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ab262363-883b-4f1a-84d4-fe431f641867 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:12.970618 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ab262363-883b-4f1a-84d4-fe431f641867 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:12.971387 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ab262363-883b-4f1a-84d4-fe431f641867 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:12.971824 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ab262363-883b-4f1a-84d4-fe431f641867 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:13.071316 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-fdb4f7af-b43b-4ec5-8bd0-9ce7c2384360 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:13.072856 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-fdb4f7af-b43b-4ec5-8bd0-9ce7c2384360 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: 32ec744c-95d9-4999-a7fe-8c884dfe1a05] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:13.100014 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fdb4f7af-b43b-4ec5-8bd0-9ce7c2384360 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:13.101179 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fdb4f7af-b43b-4ec5-8bd0-9ce7c2384360 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:13.102300 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fdb4f7af-b43b-4ec5-8bd0-9ce7c2384360 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:13.103162 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fdb4f7af-b43b-4ec5-8bd0-9ce7c2384360 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:13.123669 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=100 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:33:13.203169 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-fdb4f7af-b43b-4ec5-8bd0-9ce7c2384360 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:13.213365 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-fdb4f7af-b43b-4ec5-8bd0-9ce7c2384360 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05" status: 200 len: 1210 microversion: 2.1 time: 0.150755 May 19 06:33:13.214388 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 123/252] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:13 2022] GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05 => generated 1210 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:13.250656 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ab262363-883b-4f1a-84d4-fe431f641867 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:13.259554 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ab262363-883b-4f1a-84d4-fe431f641867 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.299910 May 19 06:33:13.260131 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 130/253] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:12 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:13.343889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e639c505-5f8d-4fbd-a138-311ce5aaae72 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:13.344574 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e639c505-5f8d-4fbd-a138-311ce5aaae72 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] [instance: d5d1dc9d-8cc9-48b5-b7ec-34535b051b30] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:13.351878 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e639c505-5f8d-4fbd-a138-311ce5aaae72 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:13.352328 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e639c505-5f8d-4fbd-a138-311ce5aaae72 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:13.353159 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e639c505-5f8d-4fbd-a138-311ce5aaae72 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:13.353618 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e639c505-5f8d-4fbd-a138-311ce5aaae72 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:13.499244 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e639c505-5f8d-4fbd-a138-311ce5aaae72 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d720bb1f5c4336a394c413d9d1c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beaccf2315245ec8959a58d23ebd293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:13.507216 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e639c505-5f8d-4fbd-a138-311ce5aaae72 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] 10.222.0.65 "GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30" status: 200 len: 1315 microversion: 2.1 time: 0.167203 May 19 06:33:13.507839 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 124/254] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:13 2022] GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:13.719958 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1b18808d-e6ef-42ea-861d-f8e9c5c7e338 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad9d8385-c3e6-4e04-8459-5b1976d67663"}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:33:13.720998 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1b18808d-e6ef-42ea-861d-f8e9c5c7e338 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:13.729798 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1b18808d-e6ef-42ea-861d-f8e9c5c7e338 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:13.730161 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1b18808d-e6ef-42ea-861d-f8e9c5c7e338 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:13.730962 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1b18808d-e6ef-42ea-861d-f8e9c5c7e338 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:13.731432 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1b18808d-e6ef-42ea-861d-f8e9c5c7e338 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:13.816390 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f05d8359-2d37-4e9f-9fb6-fc19e29250b3 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:13.816999 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f05d8359-2d37-4e9f-9fb6-fc19e29250b3 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:13.823785 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f05d8359-2d37-4e9f-9fb6-fc19e29250b3 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:13.824233 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f05d8359-2d37-4e9f-9fb6-fc19e29250b3 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:13.825012 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f05d8359-2d37-4e9f-9fb6-fc19e29250b3 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:13.826141 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f05d8359-2d37-4e9f-9fb6-fc19e29250b3 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:13.932882 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f05d8359-2d37-4e9f-9fb6-fc19e29250b3 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:13.943584 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f05d8359-2d37-4e9f-9fb6-fc19e29250b3 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd" status: 200 len: 1294 microversion: 2.1 time: 0.130581 May 19 06:33:13.955115 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 125/255] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:13 2022] GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd => generated 1294 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:33:14.229625 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c8fbe04c-4d00-4cfe-b592-e27a5fbf1a15 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:14.230519 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c8fbe04c-4d00-4cfe-b592-e27a5fbf1a15 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: 32ec744c-95d9-4999-a7fe-8c884dfe1a05] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:14.236797 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c8fbe04c-4d00-4cfe-b592-e27a5fbf1a15 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:14.237802 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c8fbe04c-4d00-4cfe-b592-e27a5fbf1a15 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:14.238598 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c8fbe04c-4d00-4cfe-b592-e27a5fbf1a15 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:14.239036 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c8fbe04c-4d00-4cfe-b592-e27a5fbf1a15 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:14.306372 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c8fbe04c-4d00-4cfe-b592-e27a5fbf1a15 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:14.315233 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c8fbe04c-4d00-4cfe-b592-e27a5fbf1a15 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05" status: 200 len: 1284 microversion: 2.1 time: 0.089505 May 19 06:33:14.316466 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 126/256] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:14 2022] GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:33:14.323518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-864497bb-56d6-49a0-8c24-f34ab9a900da tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:14.324699 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-864497bb-56d6-49a0-8c24-f34ab9a900da tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:14.335147 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-864497bb-56d6-49a0-8c24-f34ab9a900da tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:14.335839 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-864497bb-56d6-49a0-8c24-f34ab9a900da tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:14.337058 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-864497bb-56d6-49a0-8c24-f34ab9a900da tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:14.338186 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-864497bb-56d6-49a0-8c24-f34ab9a900da tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:14.500629 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-864497bb-56d6-49a0-8c24-f34ab9a900da tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:14.510021 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-864497bb-56d6-49a0-8c24-f34ab9a900da tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.192126 May 19 06:33:14.510615 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 127/257] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:14 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:14.526344 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b5292f23-f52e-4ed5-b48f-e95e93d64f01 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:14.526344 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b5292f23-f52e-4ed5-b48f-e95e93d64f01 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] [instance: d5d1dc9d-8cc9-48b5-b7ec-34535b051b30] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:14.533723 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b5292f23-f52e-4ed5-b48f-e95e93d64f01 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:14.534213 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b5292f23-f52e-4ed5-b48f-e95e93d64f01 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:14.535276 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b5292f23-f52e-4ed5-b48f-e95e93d64f01 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:14.536019 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b5292f23-f52e-4ed5-b48f-e95e93d64f01 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:14.686503 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b5292f23-f52e-4ed5-b48f-e95e93d64f01 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d720bb1f5c4336a394c413d9d1c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beaccf2315245ec8959a58d23ebd293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:14.694081 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b5292f23-f52e-4ed5-b48f-e95e93d64f01 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] 10.222.0.65 "GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30" status: 200 len: 1315 microversion: 2.1 time: 0.172817 May 19 06:33:14.694665 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 128/258] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:14 2022] GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:14.965862 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b4b2b0d3-df3d-4025-beac-23f717cf5ae5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:14.967041 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b4b2b0d3-df3d-4025-beac-23f717cf5ae5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:14.979382 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b4b2b0d3-df3d-4025-beac-23f717cf5ae5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:14.980273 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b4b2b0d3-df3d-4025-beac-23f717cf5ae5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:14.981833 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b4b2b0d3-df3d-4025-beac-23f717cf5ae5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:14.982699 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b4b2b0d3-df3d-4025-beac-23f717cf5ae5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:15.068261 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b4b2b0d3-df3d-4025-beac-23f717cf5ae5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:15.079167 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b4b2b0d3-df3d-4025-beac-23f717cf5ae5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd" status: 200 len: 1302 microversion: 2.1 time: 0.119109 May 19 06:33:15.079939 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 129/259] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:14 2022] GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd => generated 1302 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:15.333877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a8a26345-eaa2-4531-9983-cf35007963e0 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:15.334784 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a8a26345-eaa2-4531-9983-cf35007963e0 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: 32ec744c-95d9-4999-a7fe-8c884dfe1a05] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:15.341507 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a8a26345-eaa2-4531-9983-cf35007963e0 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:15.341949 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a8a26345-eaa2-4531-9983-cf35007963e0 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:15.342732 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a8a26345-eaa2-4531-9983-cf35007963e0 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:15.343157 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a8a26345-eaa2-4531-9983-cf35007963e0 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:15.409141 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a8a26345-eaa2-4531-9983-cf35007963e0 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:15.418155 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a8a26345-eaa2-4531-9983-cf35007963e0 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05" status: 200 len: 1284 microversion: 2.1 time: 0.089166 May 19 06:33:15.418757 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 130/260] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:15 2022] GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:33:15.528214 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-2f7334a9-87e0-4143-b4d8-6c70c2f7244c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:15.529078 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-2f7334a9-87e0-4143-b4d8-6c70c2f7244c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:15.535820 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2f7334a9-87e0-4143-b4d8-6c70c2f7244c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:15.536273 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2f7334a9-87e0-4143-b4d8-6c70c2f7244c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:15.537058 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2f7334a9-87e0-4143-b4d8-6c70c2f7244c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:15.537534 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2f7334a9-87e0-4143-b4d8-6c70c2f7244c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:15.690146 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2f7334a9-87e0-4143-b4d8-6c70c2f7244c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:15.699429 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-2f7334a9-87e0-4143-b4d8-6c70c2f7244c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.175035 May 19 06:33:15.700022 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 131/261] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:15 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:33:15.710982 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-eda509e2-97b8-44c8-ac8b-e7e1fa742718 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:15.711595 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-eda509e2-97b8-44c8-ac8b-e7e1fa742718 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] [instance: d5d1dc9d-8cc9-48b5-b7ec-34535b051b30] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:15.717935 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eda509e2-97b8-44c8-ac8b-e7e1fa742718 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:15.718380 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eda509e2-97b8-44c8-ac8b-e7e1fa742718 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:15.719145 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eda509e2-97b8-44c8-ac8b-e7e1fa742718 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:15.719570 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eda509e2-97b8-44c8-ac8b-e7e1fa742718 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:15.854680 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-eda509e2-97b8-44c8-ac8b-e7e1fa742718 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d720bb1f5c4336a394c413d9d1c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beaccf2315245ec8959a58d23ebd293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:15.862711 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-eda509e2-97b8-44c8-ac8b-e7e1fa742718 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] 10.222.0.65 "GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30" status: 200 len: 1315 microversion: 2.1 time: 0.155540 May 19 06:33:15.863303 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 132/262] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:15 2022] GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:33:16.096304 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-4fc76e1d-23ea-4555-a58f-a9e72d2fa117 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:16.097003 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-4fc76e1d-23ea-4555-a58f-a9e72d2fa117 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:16.103831 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4fc76e1d-23ea-4555-a58f-a9e72d2fa117 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:16.104279 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4fc76e1d-23ea-4555-a58f-a9e72d2fa117 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:16.105058 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4fc76e1d-23ea-4555-a58f-a9e72d2fa117 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:16.105523 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4fc76e1d-23ea-4555-a58f-a9e72d2fa117 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:16.177061 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4fc76e1d-23ea-4555-a58f-a9e72d2fa117 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:16.184993 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-4fc76e1d-23ea-4555-a58f-a9e72d2fa117 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd" status: 200 len: 1302 microversion: 2.1 time: 0.092594 May 19 06:33:16.185614 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 133/263] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:16 2022] GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd => generated 1302 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:33:16.435171 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c5bd2ac0-6a16-4ea5-85c3-323523704383 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:16.435799 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c5bd2ac0-6a16-4ea5-85c3-323523704383 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: 32ec744c-95d9-4999-a7fe-8c884dfe1a05] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:16.442893 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c5bd2ac0-6a16-4ea5-85c3-323523704383 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:16.443337 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c5bd2ac0-6a16-4ea5-85c3-323523704383 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:16.444121 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c5bd2ac0-6a16-4ea5-85c3-323523704383 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:16.444550 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c5bd2ac0-6a16-4ea5-85c3-323523704383 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:16.510206 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c5bd2ac0-6a16-4ea5-85c3-323523704383 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:16.518596 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c5bd2ac0-6a16-4ea5-85c3-323523704383 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05" status: 200 len: 1284 microversion: 2.1 time: 0.087158 May 19 06:33:16.519472 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 134/264] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:16 2022] GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:33:16.717392 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3b85b940-32fd-42f8-83b2-5cec8b7dde03 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:16.718008 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-3b85b940-32fd-42f8-83b2-5cec8b7dde03 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:16.725346 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3b85b940-32fd-42f8-83b2-5cec8b7dde03 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:16.725792 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3b85b940-32fd-42f8-83b2-5cec8b7dde03 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:16.726558 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3b85b940-32fd-42f8-83b2-5cec8b7dde03 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:16.726982 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3b85b940-32fd-42f8-83b2-5cec8b7dde03 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:16.872815 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3b85b940-32fd-42f8-83b2-5cec8b7dde03 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:16.881311 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-3b85b940-32fd-42f8-83b2-5cec8b7dde03 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.167758 May 19 06:33:16.881893 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 135/265] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:16 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:33:16.886414 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ed6e3f18-b62d-439d-befd-4e6ec69d15cf tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:16.887004 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ed6e3f18-b62d-439d-befd-4e6ec69d15cf tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] [instance: d5d1dc9d-8cc9-48b5-b7ec-34535b051b30] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:16.894107 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ed6e3f18-b62d-439d-befd-4e6ec69d15cf tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:16.894582 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ed6e3f18-b62d-439d-befd-4e6ec69d15cf tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:16.895310 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ed6e3f18-b62d-439d-befd-4e6ec69d15cf tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:16.895922 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ed6e3f18-b62d-439d-befd-4e6ec69d15cf tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:17.266189 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ed6e3f18-b62d-439d-befd-4e6ec69d15cf tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d720bb1f5c4336a394c413d9d1c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beaccf2315245ec8959a58d23ebd293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:17.275030 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ed6e3f18-b62d-439d-befd-4e6ec69d15cf tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] 10.222.0.65 "GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30" status: 200 len: 1315 microversion: 2.1 time: 0.392063 May 19 06:33:17.275634 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 136/266] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:16 2022] GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:17.282250 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-981b4a3a-9394-4e13-80fc-8adfcd6935d1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:17.282649 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-981b4a3a-9394-4e13-80fc-8adfcd6935d1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:17.289843 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-981b4a3a-9394-4e13-80fc-8adfcd6935d1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:17.290462 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-981b4a3a-9394-4e13-80fc-8adfcd6935d1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:17.291241 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-981b4a3a-9394-4e13-80fc-8adfcd6935d1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:17.291673 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-981b4a3a-9394-4e13-80fc-8adfcd6935d1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:17.468711 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-981b4a3a-9394-4e13-80fc-8adfcd6935d1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:17.480024 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-981b4a3a-9394-4e13-80fc-8adfcd6935d1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd" status: 200 len: 1302 microversion: 2.1 time: 0.203307 May 19 06:33:17.480615 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 137/267] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:17 2022] GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd => generated 1302 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:17.537628 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-aeb2b4a8-8338-445e-b725-67a2caedb3fb tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:17.538629 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-aeb2b4a8-8338-445e-b725-67a2caedb3fb tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: 32ec744c-95d9-4999-a7fe-8c884dfe1a05] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:17.555144 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-aeb2b4a8-8338-445e-b725-67a2caedb3fb tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:17.555580 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-aeb2b4a8-8338-445e-b725-67a2caedb3fb tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:17.562265 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-aeb2b4a8-8338-445e-b725-67a2caedb3fb tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:17.565056 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-aeb2b4a8-8338-445e-b725-67a2caedb3fb tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:17.692104 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1b18808d-e6ef-42ea-861d-f8e9c5c7e338 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "POST /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.975816 May 19 06:33:17.694984 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 131/268] 10.222.0.65 () {60 vars in 1322 bytes} [Thu May 19 06:33:13 2022] POST /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac/os-volume_attachments => generated 194 bytes in 3980 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:33:17.807825 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-aeb2b4a8-8338-445e-b725-67a2caedb3fb tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:17.823902 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-aeb2b4a8-8338-445e-b725-67a2caedb3fb tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05" status: 200 len: 1272 microversion: 2.1 time: 0.287182 May 19 06:33:17.829492 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 138/269] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:17 2022] GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05 => generated 1272 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:17.912548 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c553bcbc-4d87-4780-a388-9874100b2b09 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:17.914430 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c553bcbc-4d87-4780-a388-9874100b2b09 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:17.939448 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c553bcbc-4d87-4780-a388-9874100b2b09 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:17.943219 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c553bcbc-4d87-4780-a388-9874100b2b09 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:17.946115 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c553bcbc-4d87-4780-a388-9874100b2b09 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:17.947204 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c553bcbc-4d87-4780-a388-9874100b2b09 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:18.260075 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c553bcbc-4d87-4780-a388-9874100b2b09 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:18.272658 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:33:18.276901 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c553bcbc-4d87-4780-a388-9874100b2b09 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.380795 May 19 06:33:18.291034 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 132/270] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:17 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:18.296154 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-bda419d5-0593-4752-b573-2263dc58782c tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:18.297661 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-bda419d5-0593-4752-b573-2263dc58782c tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] [instance: d5d1dc9d-8cc9-48b5-b7ec-34535b051b30] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:18.307930 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bda419d5-0593-4752-b573-2263dc58782c tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:18.308406 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bda419d5-0593-4752-b573-2263dc58782c tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:18.309245 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bda419d5-0593-4752-b573-2263dc58782c tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:18.309691 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bda419d5-0593-4752-b573-2263dc58782c tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:18.496579 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-5c41fa4a-19b7-4185-8b23-4bf841c2c774 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:18.497721 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-5c41fa4a-19b7-4185-8b23-4bf841c2c774 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:18.506722 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5c41fa4a-19b7-4185-8b23-4bf841c2c774 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:18.507155 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5c41fa4a-19b7-4185-8b23-4bf841c2c774 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:18.508591 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5c41fa4a-19b7-4185-8b23-4bf841c2c774 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:18.509038 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5c41fa4a-19b7-4185-8b23-4bf841c2c774 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:18.626013 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-5c41fa4a-19b7-4185-8b23-4bf841c2c774 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:18.641541 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-5c41fa4a-19b7-4185-8b23-4bf841c2c774 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd" status: 200 len: 1300 microversion: 2.1 time: 0.148794 May 19 06:33:18.645162 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 133/271] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:18 2022] GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd => generated 1300 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:33:18.829082 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-bda419d5-0593-4752-b573-2263dc58782c tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d720bb1f5c4336a394c413d9d1c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beaccf2315245ec8959a58d23ebd293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:18.833306 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=100 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:33:18.844001 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e0072c9d-b612-4274-984c-7631cfa1fd4c tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:18.845070 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e0072c9d-b612-4274-984c-7631cfa1fd4c tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: 32ec744c-95d9-4999-a7fe-8c884dfe1a05] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:18.855133 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-bda419d5-0593-4752-b573-2263dc58782c tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] 10.222.0.65 "GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30" status: 200 len: 1315 microversion: 2.1 time: 0.563153 May 19 06:33:18.855807 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 139/272] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:18 2022] GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 => generated 1315 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:33:18.876467 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e0072c9d-b612-4274-984c-7631cfa1fd4c tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:18.877578 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e0072c9d-b612-4274-984c-7631cfa1fd4c tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:18.881373 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e0072c9d-b612-4274-984c-7631cfa1fd4c tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:18.882402 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e0072c9d-b612-4274-984c-7631cfa1fd4c tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:19.009570 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-f0c4f759-67ed-42de-a20e-f3cc772bc8e6 req-e4ef609a-8252-449c-918e-fc6dd18bfeff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d1dc9d-8cc9-48b5-b7ec-34535b051b30", "name": "network-vif-plugged", "status": "completed", "tag": "58286b94-de20-44e2-b14e-60bc473bc84e"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:33:19.024038 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-f0c4f759-67ed-42de-a20e-f3cc772bc8e6 req-e4ef609a-8252-449c-918e-fc6dd18bfeff service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:19.028138 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-f0c4f759-67ed-42de-a20e-f3cc772bc8e6 req-e4ef609a-8252-449c-918e-fc6dd18bfeff service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:19.060910 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-f0c4f759-67ed-42de-a20e-f3cc772bc8e6 req-e4ef609a-8252-449c-918e-fc6dd18bfeff service nova] Creating event network-vif-plugged:58286b94-de20-44e2-b14e-60bc473bc84e for instance d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 on hv-cinder-83699 May 19 06:33:19.067900 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-f0c4f759-67ed-42de-a20e-f3cc772bc8e6 req-e4ef609a-8252-449c-918e-fc6dd18bfeff service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064742 May 19 06:33:19.069092 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 140/273] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:33:19.211807 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e0072c9d-b612-4274-984c-7631cfa1fd4c tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:19.222283 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e0072c9d-b612-4274-984c-7631cfa1fd4c tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05" status: 200 len: 1314 microversion: 2.1 time: 0.382631 May 19 06:33:19.233614 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 134/274] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:18 2022] GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:19.295988 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e362205c-80ff-4770-9c27-88335022ab18 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:19.297127 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e362205c-80ff-4770-9c27-88335022ab18 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:19.307689 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e362205c-80ff-4770-9c27-88335022ab18 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:19.308420 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e362205c-80ff-4770-9c27-88335022ab18 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:19.309524 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e362205c-80ff-4770-9c27-88335022ab18 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:19.310218 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e362205c-80ff-4770-9c27-88335022ab18 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:19.641787 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e362205c-80ff-4770-9c27-88335022ab18 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:19.665719 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e362205c-80ff-4770-9c27-88335022ab18 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.373839 May 19 06:33:19.666996 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 141/275] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:19 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:19.678410 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-61539b10-0726-4862-94a7-084f62249f83 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:19.679581 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-61539b10-0726-4862-94a7-084f62249f83 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:19.691754 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-61539b10-0726-4862-94a7-084f62249f83 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:19.693081 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-61539b10-0726-4862-94a7-084f62249f83 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:19.694552 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-61539b10-0726-4862-94a7-084f62249f83 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:19.695305 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-61539b10-0726-4862-94a7-084f62249f83 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:19.834966 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-e82cb242-f86a-44e1-9260-4b3a01194917 req-1fa64b9c-4dfe-4d38-8e4c-5690a0de1134 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32ec744c-95d9-4999-a7fe-8c884dfe1a05", "tag": "3c7095f0-e36d-4777-bd29-b6064d1fc76d"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:33:19.855634 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-e82cb242-f86a-44e1-9260-4b3a01194917 req-1fa64b9c-4dfe-4d38-8e4c-5690a0de1134 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:19.856082 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-e82cb242-f86a-44e1-9260-4b3a01194917 req-1fa64b9c-4dfe-4d38-8e4c-5690a0de1134 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:19.881404 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-e82cb242-f86a-44e1-9260-4b3a01194917 req-1fa64b9c-4dfe-4d38-8e4c-5690a0de1134 service nova] Creating event network-changed:3c7095f0-e36d-4777-bd29-b6064d1fc76d for instance 32ec744c-95d9-4999-a7fe-8c884dfe1a05 on hv-cinder-83699 May 19 06:33:19.887295 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-e82cb242-f86a-44e1-9260-4b3a01194917 req-1fa64b9c-4dfe-4d38-8e4c-5690a0de1134 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056411 May 19 06:33:19.888206 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 142/276] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:33:19.893647 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7373b478-8b86-4b45-8f5d-05ff19cc11b2 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:19.903246 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7373b478-8b86-4b45-8f5d-05ff19cc11b2 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] [instance: d5d1dc9d-8cc9-48b5-b7ec-34535b051b30] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:19.916480 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7373b478-8b86-4b45-8f5d-05ff19cc11b2 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:19.916950 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7373b478-8b86-4b45-8f5d-05ff19cc11b2 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:19.917840 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7373b478-8b86-4b45-8f5d-05ff19cc11b2 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:19.918276 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7373b478-8b86-4b45-8f5d-05ff19cc11b2 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:19.985099 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-61539b10-0726-4862-94a7-084f62249f83 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:19.994632 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-61539b10-0726-4862-94a7-084f62249f83 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd" status: 200 len: 1367 microversion: 2.1 time: 0.334294 May 19 06:33:19.995229 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 135/277] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:19 2022] GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd => generated 1367 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:33:20.144999 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7373b478-8b86-4b45-8f5d-05ff19cc11b2 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d720bb1f5c4336a394c413d9d1c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beaccf2315245ec8959a58d23ebd293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:20.162008 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7373b478-8b86-4b45-8f5d-05ff19cc11b2 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] 10.222.0.65 "GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30" status: 200 len: 1315 microversion: 2.1 time: 0.272395 May 19 06:33:20.163111 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 143/278] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:19 2022] GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:20.241234 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-5b3836ce-7d98-4864-ad10-13799974b6ef tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:20.241891 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-5b3836ce-7d98-4864-ad10-13799974b6ef tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: 32ec744c-95d9-4999-a7fe-8c884dfe1a05] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:20.250696 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5b3836ce-7d98-4864-ad10-13799974b6ef tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:20.254398 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5b3836ce-7d98-4864-ad10-13799974b6ef tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:20.257685 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5b3836ce-7d98-4864-ad10-13799974b6ef tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:20.259174 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5b3836ce-7d98-4864-ad10-13799974b6ef tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:20.675154 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-5b3836ce-7d98-4864-ad10-13799974b6ef tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:20.684746 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-eb8b5fc0-5da3-43f9-b073-227ef7351085 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:20.686015 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-eb8b5fc0-5da3-43f9-b073-227ef7351085 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:20.697014 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-5b3836ce-7d98-4864-ad10-13799974b6ef tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05" status: 200 len: 1314 microversion: 2.1 time: 0.460583 May 19 06:33:20.700761 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 136/279] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:20 2022] GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05 => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:20.703094 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb8b5fc0-5da3-43f9-b073-227ef7351085 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:20.703768 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb8b5fc0-5da3-43f9-b073-227ef7351085 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:20.704549 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb8b5fc0-5da3-43f9-b073-227ef7351085 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:20.705133 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb8b5fc0-5da3-43f9-b073-227ef7351085 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:21.005774 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-eb8b5fc0-5da3-43f9-b073-227ef7351085 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:21.019770 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-eb8b5fc0-5da3-43f9-b073-227ef7351085 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.339305 May 19 06:33:21.020706 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 144/280] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:20 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:33:21.041715 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e915bcb9-7740-45b3-a910-d0fd4acc53a6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:21.044269 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e915bcb9-7740-45b3-a910-d0fd4acc53a6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:21.056819 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e915bcb9-7740-45b3-a910-d0fd4acc53a6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:21.057318 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e915bcb9-7740-45b3-a910-d0fd4acc53a6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:21.058122 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e915bcb9-7740-45b3-a910-d0fd4acc53a6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:21.058568 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e915bcb9-7740-45b3-a910-d0fd4acc53a6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:21.180286 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-60ac4242-3758-4b3b-b4c8-88accf73a68e tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:21.181003 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-60ac4242-3758-4b3b-b4c8-88accf73a68e tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] [instance: d5d1dc9d-8cc9-48b5-b7ec-34535b051b30] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:21.188191 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-60ac4242-3758-4b3b-b4c8-88accf73a68e tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:21.194749 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-60ac4242-3758-4b3b-b4c8-88accf73a68e tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:21.195817 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-60ac4242-3758-4b3b-b4c8-88accf73a68e tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:21.196698 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-60ac4242-3758-4b3b-b4c8-88accf73a68e tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:21.442115 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e915bcb9-7740-45b3-a910-d0fd4acc53a6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:21.458164 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e915bcb9-7740-45b3-a910-d0fd4acc53a6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd" status: 200 len: 1367 microversion: 2.1 time: 0.446885 May 19 06:33:21.459284 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 137/281] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:21 2022] GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd => generated 1367 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:21.501578 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-60ac4242-3758-4b3b-b4c8-88accf73a68e tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d720bb1f5c4336a394c413d9d1c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beaccf2315245ec8959a58d23ebd293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:21.540032 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-1a5a8455-bc5d-43e6-9cbf-a1c911a170fe req-e32c28a5-54fb-40c5-a8b8-75c6eaff26e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8943880-a4d3-49d5-8c02-88ff7343f5fd", "tag": "f34db898-32c0-4c35-871a-443b193021aa"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:33:21.544660 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-60ac4242-3758-4b3b-b4c8-88accf73a68e tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] 10.222.0.65 "GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30" status: 200 len: 1465 microversion: 2.1 time: 0.343530 May 19 06:33:21.552101 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 145/282] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:21 2022] GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 => generated 1465 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:33:21.554129 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=6 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:33:21.555753 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=20 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:33:21.569742 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-1a5a8455-bc5d-43e6-9cbf-a1c911a170fe req-e32c28a5-54fb-40c5-a8b8-75c6eaff26e1 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:21.571345 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-1a5a8455-bc5d-43e6-9cbf-a1c911a170fe req-e32c28a5-54fb-40c5-a8b8-75c6eaff26e1 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:21.601386 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-1a5a8455-bc5d-43e6-9cbf-a1c911a170fe req-e32c28a5-54fb-40c5-a8b8-75c6eaff26e1 service nova] Creating event network-changed:f34db898-32c0-4c35-871a-443b193021aa for instance e8943880-a4d3-49d5-8c02-88ff7343f5fd on hv-cinder-83699 May 19 06:33:21.608546 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0c1dcdc2-24ee-49a0-92eb-93a67c92ebcc tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:21.610012 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0c1dcdc2-24ee-49a0-92eb-93a67c92ebcc tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] [instance: d5d1dc9d-8cc9-48b5-b7ec-34535b051b30] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:21.615416 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-1a5a8455-bc5d-43e6-9cbf-a1c911a170fe req-e32c28a5-54fb-40c5-a8b8-75c6eaff26e1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087474 May 19 06:33:21.616555 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 138/283] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:33:21.625529 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0c1dcdc2-24ee-49a0-92eb-93a67c92ebcc tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:21.626231 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0c1dcdc2-24ee-49a0-92eb-93a67c92ebcc tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:21.629002 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0c1dcdc2-24ee-49a0-92eb-93a67c92ebcc tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:21.629637 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0c1dcdc2-24ee-49a0-92eb-93a67c92ebcc tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:21.695336 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0c1dcdc2-24ee-49a0-92eb-93a67c92ebcc tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] [instance: d5d1dc9d-8cc9-48b5-b7ec-34535b051b30] Going to try to terminate instance {{(pid=117711) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 06:33:21.701209 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=8 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:33:21.728811 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e4be3a59-35f7-43b7-b7b0-f3c43e26134f tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:21.732410 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e4be3a59-35f7-43b7-b7b0-f3c43e26134f tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: 32ec744c-95d9-4999-a7fe-8c884dfe1a05] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:21.746607 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e4be3a59-35f7-43b7-b7b0-f3c43e26134f tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:21.747469 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e4be3a59-35f7-43b7-b7b0-f3c43e26134f tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:21.748298 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e4be3a59-35f7-43b7-b7b0-f3c43e26134f tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:21.748947 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e4be3a59-35f7-43b7-b7b0-f3c43e26134f tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:21.852683 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0c1dcdc2-24ee-49a0-92eb-93a67c92ebcc tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30" status: 204 len: 0 microversion: 2.1 time: 0.251704 May 19 06:33:21.858114 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 146/284] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 06:33:21 2022] DELETE /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 06:33:21.866451 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b9d42d03-4574-4784-8162-2b3c1d604d72 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:21.867982 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b9d42d03-4574-4784-8162-2b3c1d604d72 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] [instance: d5d1dc9d-8cc9-48b5-b7ec-34535b051b30] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:21.875898 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b9d42d03-4574-4784-8162-2b3c1d604d72 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:21.878309 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b9d42d03-4574-4784-8162-2b3c1d604d72 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:21.879402 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b9d42d03-4574-4784-8162-2b3c1d604d72 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:21.880746 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b9d42d03-4574-4784-8162-2b3c1d604d72 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:22.079902 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b9d42d03-4574-4784-8162-2b3c1d604d72 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d720bb1f5c4336a394c413d9d1c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beaccf2315245ec8959a58d23ebd293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:22.092545 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b9d42d03-4574-4784-8162-2b3c1d604d72 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] 10.222.0.65 "GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30" status: 200 len: 1471 microversion: 2.1 time: 0.232433 May 19 06:33:22.094476 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 147/285] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:21 2022] GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 => generated 1471 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:22.103632 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-522ae226-eece-4179-aa53-d99ff9c8afb7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:22.104593 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-522ae226-eece-4179-aa53-d99ff9c8afb7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:22.113569 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-522ae226-eece-4179-aa53-d99ff9c8afb7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:22.114351 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-522ae226-eece-4179-aa53-d99ff9c8afb7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:22.115859 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-522ae226-eece-4179-aa53-d99ff9c8afb7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:22.116631 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-522ae226-eece-4179-aa53-d99ff9c8afb7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:22.121331 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e4be3a59-35f7-43b7-b7b0-f3c43e26134f tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:22.132255 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e4be3a59-35f7-43b7-b7b0-f3c43e26134f tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05" status: 200 len: 1314 microversion: 2.1 time: 0.407208 May 19 06:33:22.132431 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 139/286] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:21 2022] GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:33:22.382265 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-522ae226-eece-4179-aa53-d99ff9c8afb7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:22.396436 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-522ae226-eece-4179-aa53-d99ff9c8afb7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.300457 May 19 06:33:22.397703 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 148/287] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:22 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:22.491698 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-58cc53aa-5668-4bf1-96bc-f92de70a294d tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:22.492757 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-58cc53aa-5668-4bf1-96bc-f92de70a294d tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:22.504953 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-58cc53aa-5668-4bf1-96bc-f92de70a294d tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:22.505828 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-58cc53aa-5668-4bf1-96bc-f92de70a294d tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:22.507099 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-58cc53aa-5668-4bf1-96bc-f92de70a294d tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:22.507806 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-58cc53aa-5668-4bf1-96bc-f92de70a294d tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:22.782835 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-58cc53aa-5668-4bf1-96bc-f92de70a294d tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:22.797468 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-58cc53aa-5668-4bf1-96bc-f92de70a294d tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd" status: 200 len: 1367 microversion: 2.1 time: 0.314537 May 19 06:33:22.814036 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 140/288] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:22 2022] GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd => generated 1367 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:23.119582 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-05b38bc6-8f1a-4858-9699-974a4f5c21b4 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:23.120510 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-05b38bc6-8f1a-4858-9699-974a4f5c21b4 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] [instance: d5d1dc9d-8cc9-48b5-b7ec-34535b051b30] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:23.127153 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-05b38bc6-8f1a-4858-9699-974a4f5c21b4 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:23.127739 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-05b38bc6-8f1a-4858-9699-974a4f5c21b4 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:23.128499 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-05b38bc6-8f1a-4858-9699-974a4f5c21b4 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:23.129066 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-05b38bc6-8f1a-4858-9699-974a4f5c21b4 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:23.152625 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3f7dd54a-d747-438b-9eda-41eac603e5b6 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:23.153847 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3f7dd54a-d747-438b-9eda-41eac603e5b6 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: 32ec744c-95d9-4999-a7fe-8c884dfe1a05] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:23.162230 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3f7dd54a-d747-438b-9eda-41eac603e5b6 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:23.163124 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3f7dd54a-d747-438b-9eda-41eac603e5b6 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:23.163940 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3f7dd54a-d747-438b-9eda-41eac603e5b6 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:23.164527 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3f7dd54a-d747-438b-9eda-41eac603e5b6 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:23.328998 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-05b38bc6-8f1a-4858-9699-974a4f5c21b4 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d720bb1f5c4336a394c413d9d1c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beaccf2315245ec8959a58d23ebd293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:23.344909 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-05b38bc6-8f1a-4858-9699-974a4f5c21b4 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] 10.222.0.65 "GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30" status: 200 len: 1471 microversion: 2.1 time: 0.229231 May 19 06:33:23.347726 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 149/289] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:23 2022] GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 => generated 1471 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:23.396493 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3f7dd54a-d747-438b-9eda-41eac603e5b6 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:23.407476 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3f7dd54a-d747-438b-9eda-41eac603e5b6 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05" status: 200 len: 1314 microversion: 2.1 time: 0.260854 May 19 06:33:23.408237 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 141/290] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:23 2022] GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:23.422673 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3b189dbd-3317-4138-95cb-589e42c02d6f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:23.423414 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-3b189dbd-3317-4138-95cb-589e42c02d6f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:23.435338 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3b189dbd-3317-4138-95cb-589e42c02d6f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:23.435788 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3b189dbd-3317-4138-95cb-589e42c02d6f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:23.436619 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3b189dbd-3317-4138-95cb-589e42c02d6f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:23.437063 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3b189dbd-3317-4138-95cb-589e42c02d6f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:23.637224 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3b189dbd-3317-4138-95cb-589e42c02d6f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:23.648752 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-3b189dbd-3317-4138-95cb-589e42c02d6f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.237122 May 19 06:33:23.649823 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 150/291] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:23 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:23.835640 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-5063cd89-5140-41f9-8421-8d0d21213f04 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:23.836237 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-5063cd89-5140-41f9-8421-8d0d21213f04 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:23.845695 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5063cd89-5140-41f9-8421-8d0d21213f04 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:23.846130 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5063cd89-5140-41f9-8421-8d0d21213f04 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:23.848146 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5063cd89-5140-41f9-8421-8d0d21213f04 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:23.848754 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5063cd89-5140-41f9-8421-8d0d21213f04 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:24.136655 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-5063cd89-5140-41f9-8421-8d0d21213f04 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:24.155627 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-5063cd89-5140-41f9-8421-8d0d21213f04 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd" status: 200 len: 1367 microversion: 2.1 time: 0.331664 May 19 06:33:24.156657 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 142/292] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:23 2022] GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd => generated 1367 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:33:24.365408 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-af2bc33d-8923-483e-9300-d8348fcad45f tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:24.366345 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-af2bc33d-8923-483e-9300-d8348fcad45f tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] [instance: d5d1dc9d-8cc9-48b5-b7ec-34535b051b30] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:24.377970 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-af2bc33d-8923-483e-9300-d8348fcad45f tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:24.389926 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-af2bc33d-8923-483e-9300-d8348fcad45f tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:24.390958 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-af2bc33d-8923-483e-9300-d8348fcad45f tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:24.391514 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-af2bc33d-8923-483e-9300-d8348fcad45f tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:24.426325 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-54919153-8061-47b1-a8d2-cf28ef2d9f96 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:24.427244 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-54919153-8061-47b1-a8d2-cf28ef2d9f96 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: 32ec744c-95d9-4999-a7fe-8c884dfe1a05] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:24.435702 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-54919153-8061-47b1-a8d2-cf28ef2d9f96 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:24.441338 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-54919153-8061-47b1-a8d2-cf28ef2d9f96 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:24.442320 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-54919153-8061-47b1-a8d2-cf28ef2d9f96 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:24.442767 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-54919153-8061-47b1-a8d2-cf28ef2d9f96 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:24.666805 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-af2bc33d-8923-483e-9300-d8348fcad45f tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d720bb1f5c4336a394c413d9d1c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beaccf2315245ec8959a58d23ebd293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:24.676193 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-af2bc33d-8923-483e-9300-d8348fcad45f tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] 10.222.0.65 "GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30" status: 200 len: 1471 microversion: 2.1 time: 0.315819 May 19 06:33:24.677351 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 151/293] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:24 2022] GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 => generated 1471 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:24.699438 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-40e3b39c-d74b-459a-8b34-4ce76241cc93 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:24.700894 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-40e3b39c-d74b-459a-8b34-4ce76241cc93 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:24.712145 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-40e3b39c-d74b-459a-8b34-4ce76241cc93 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:24.713244 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-40e3b39c-d74b-459a-8b34-4ce76241cc93 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:24.714879 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-40e3b39c-d74b-459a-8b34-4ce76241cc93 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:24.716134 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-40e3b39c-d74b-459a-8b34-4ce76241cc93 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:24.870913 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-54919153-8061-47b1-a8d2-cf28ef2d9f96 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:24.890472 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-54919153-8061-47b1-a8d2-cf28ef2d9f96 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05" status: 200 len: 1314 microversion: 2.1 time: 0.467649 May 19 06:33:24.891561 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 143/294] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:24 2022] GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05 => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:25.028900 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-40e3b39c-d74b-459a-8b34-4ce76241cc93 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:25.039929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-40e3b39c-d74b-459a-8b34-4ce76241cc93 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.360469 May 19 06:33:25.042010 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 152/295] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:24 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:25.173721 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ec6e36f4-00ae-4a2c-b91d-b06cd1a0ce46 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:25.174721 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ec6e36f4-00ae-4a2c-b91d-b06cd1a0ce46 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:25.180626 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ec6e36f4-00ae-4a2c-b91d-b06cd1a0ce46 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:25.181146 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ec6e36f4-00ae-4a2c-b91d-b06cd1a0ce46 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:25.181950 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ec6e36f4-00ae-4a2c-b91d-b06cd1a0ce46 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:25.182557 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ec6e36f4-00ae-4a2c-b91d-b06cd1a0ce46 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:25.434889 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ec6e36f4-00ae-4a2c-b91d-b06cd1a0ce46 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:25.449562 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ec6e36f4-00ae-4a2c-b91d-b06cd1a0ce46 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd" status: 200 len: 1367 microversion: 2.1 time: 0.280173 May 19 06:33:25.454820 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 144/296] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:25 2022] GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:25.693065 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c26d26fa-7ad5-446c-b195-2ac94de92012 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:25.694372 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c26d26fa-7ad5-446c-b195-2ac94de92012 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] [instance: d5d1dc9d-8cc9-48b5-b7ec-34535b051b30] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:25.702310 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c26d26fa-7ad5-446c-b195-2ac94de92012 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:25.702783 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c26d26fa-7ad5-446c-b195-2ac94de92012 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:25.703600 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c26d26fa-7ad5-446c-b195-2ac94de92012 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:25.704087 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c26d26fa-7ad5-446c-b195-2ac94de92012 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:25.877428 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c26d26fa-7ad5-446c-b195-2ac94de92012 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d720bb1f5c4336a394c413d9d1c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beaccf2315245ec8959a58d23ebd293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:25.885270 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c26d26fa-7ad5-446c-b195-2ac94de92012 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] 10.222.0.65 "GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30" status: 200 len: 1471 microversion: 2.1 time: 0.196184 May 19 06:33:25.885931 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 153/297] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:25 2022] GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 => generated 1471 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:25.910776 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c6143e5c-9772-4718-aae4-6371814e11f6 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:25.911548 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c6143e5c-9772-4718-aae4-6371814e11f6 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: 32ec744c-95d9-4999-a7fe-8c884dfe1a05] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:25.917516 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c6143e5c-9772-4718-aae4-6371814e11f6 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:25.917963 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c6143e5c-9772-4718-aae4-6371814e11f6 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:25.918745 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c6143e5c-9772-4718-aae4-6371814e11f6 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:25.919177 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c6143e5c-9772-4718-aae4-6371814e11f6 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:26.058495 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b3d683aa-12c9-4f2c-8f06-c6734f244c23 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:26.060068 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b3d683aa-12c9-4f2c-8f06-c6734f244c23 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:26.069112 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b3d683aa-12c9-4f2c-8f06-c6734f244c23 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:26.069844 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b3d683aa-12c9-4f2c-8f06-c6734f244c23 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:26.071074 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b3d683aa-12c9-4f2c-8f06-c6734f244c23 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:26.071668 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b3d683aa-12c9-4f2c-8f06-c6734f244c23 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:26.199990 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c6143e5c-9772-4718-aae4-6371814e11f6 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:26.214053 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c6143e5c-9772-4718-aae4-6371814e11f6 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05" status: 200 len: 1314 microversion: 2.1 time: 0.308052 May 19 06:33:26.225890 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 145/298] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:25 2022] GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:26.263225 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b3d683aa-12c9-4f2c-8f06-c6734f244c23 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:26.272972 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b3d683aa-12c9-4f2c-8f06-c6734f244c23 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.218286 May 19 06:33:26.273982 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 154/299] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:26 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:33:26.470881 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-88240b87-163f-4c23-a921-2cd0dd235f1a tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:26.472206 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-88240b87-163f-4c23-a921-2cd0dd235f1a tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:26.484793 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-88240b87-163f-4c23-a921-2cd0dd235f1a tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:26.486421 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-88240b87-163f-4c23-a921-2cd0dd235f1a tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:26.489030 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-88240b87-163f-4c23-a921-2cd0dd235f1a tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:26.489734 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-88240b87-163f-4c23-a921-2cd0dd235f1a tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:26.902407 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-4fa8e5a1-682e-4d70-b71d-a10fb860bfaa tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:26.903007 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-4fa8e5a1-682e-4d70-b71d-a10fb860bfaa tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] [instance: d5d1dc9d-8cc9-48b5-b7ec-34535b051b30] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:26.912544 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4fa8e5a1-682e-4d70-b71d-a10fb860bfaa tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:26.916952 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4fa8e5a1-682e-4d70-b71d-a10fb860bfaa tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:26.918061 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4fa8e5a1-682e-4d70-b71d-a10fb860bfaa tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:26.920782 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4fa8e5a1-682e-4d70-b71d-a10fb860bfaa tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:27.128400 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-88240b87-163f-4c23-a921-2cd0dd235f1a tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:27.141261 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-88240b87-163f-4c23-a921-2cd0dd235f1a tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd" status: 200 len: 1367 microversion: 2.1 time: 0.672465 May 19 06:33:27.141923 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 146/300] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:26 2022] GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd => generated 1367 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:27.146233 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4fa8e5a1-682e-4d70-b71d-a10fb860bfaa tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d720bb1f5c4336a394c413d9d1c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beaccf2315245ec8959a58d23ebd293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:27.165412 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-4fa8e5a1-682e-4d70-b71d-a10fb860bfaa tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] 10.222.0.65 "GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30" status: 200 len: 1471 microversion: 2.1 time: 0.267296 May 19 06:33:27.167357 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 155/301] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:26 2022] GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 => generated 1471 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:27.231961 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-94dc9546-9192-4206-8f90-77682403b296 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:27.232567 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-94dc9546-9192-4206-8f90-77682403b296 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: 32ec744c-95d9-4999-a7fe-8c884dfe1a05] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:27.240475 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-94dc9546-9192-4206-8f90-77682403b296 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:27.241228 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-94dc9546-9192-4206-8f90-77682403b296 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:27.242373 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-94dc9546-9192-4206-8f90-77682403b296 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:27.243204 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-94dc9546-9192-4206-8f90-77682403b296 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:27.291974 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-19c757fb-b762-4c85-a023-f0a48f1f596f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:27.292801 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-19c757fb-b762-4c85-a023-f0a48f1f596f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:27.303325 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-19c757fb-b762-4c85-a023-f0a48f1f596f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:27.303781 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-19c757fb-b762-4c85-a023-f0a48f1f596f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:27.304741 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-19c757fb-b762-4c85-a023-f0a48f1f596f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:27.305182 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-19c757fb-b762-4c85-a023-f0a48f1f596f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:27.308422 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:33:27.569401 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-19c757fb-b762-4c85-a023-f0a48f1f596f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:27.578600 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-19c757fb-b762-4c85-a023-f0a48f1f596f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.291868 May 19 06:33:27.579185 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 156/302] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:27 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:33:27.613754 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-94dc9546-9192-4206-8f90-77682403b296 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:27.622040 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-94dc9546-9192-4206-8f90-77682403b296 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05" status: 200 len: 1314 microversion: 2.1 time: 0.393785 May 19 06:33:27.622762 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 147/303] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:27 2022] GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:28.160658 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0b36773e-5206-4232-88e7-2a8b223ed0bf tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:28.161522 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0b36773e-5206-4232-88e7-2a8b223ed0bf tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:28.169111 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0b36773e-5206-4232-88e7-2a8b223ed0bf tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:28.169734 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0b36773e-5206-4232-88e7-2a8b223ed0bf tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:28.171634 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0b36773e-5206-4232-88e7-2a8b223ed0bf tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:28.172287 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0b36773e-5206-4232-88e7-2a8b223ed0bf tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:28.185431 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-08cc0f39-8ddb-437f-a2a0-1cb64e0d74a5 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:28.186457 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-08cc0f39-8ddb-437f-a2a0-1cb64e0d74a5 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] [instance: d5d1dc9d-8cc9-48b5-b7ec-34535b051b30] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:28.201136 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-08cc0f39-8ddb-437f-a2a0-1cb64e0d74a5 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:28.202103 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-08cc0f39-8ddb-437f-a2a0-1cb64e0d74a5 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:28.203126 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-08cc0f39-8ddb-437f-a2a0-1cb64e0d74a5 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:28.203768 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-08cc0f39-8ddb-437f-a2a0-1cb64e0d74a5 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:28.386185 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0b36773e-5206-4232-88e7-2a8b223ed0bf tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:28.400659 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0b36773e-5206-4232-88e7-2a8b223ed0bf tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd" status: 200 len: 1367 microversion: 2.1 time: 0.245220 May 19 06:33:28.401800 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 157/304] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:28 2022] GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:28.531817 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-08cc0f39-8ddb-437f-a2a0-1cb64e0d74a5 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d720bb1f5c4336a394c413d9d1c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beaccf2315245ec8959a58d23ebd293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:28.543131 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-08cc0f39-8ddb-437f-a2a0-1cb64e0d74a5 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] 10.222.0.65 "GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30" status: 200 len: 1471 microversion: 2.1 time: 0.361932 May 19 06:33:28.543747 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 148/305] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:28 2022] GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 => generated 1471 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:28.600206 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f522eaf8-da64-46af-ad82-817fac6d77a7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:28.601059 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f522eaf8-da64-46af-ad82-817fac6d77a7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:28.614396 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f522eaf8-da64-46af-ad82-817fac6d77a7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:28.615313 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f522eaf8-da64-46af-ad82-817fac6d77a7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:28.617131 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f522eaf8-da64-46af-ad82-817fac6d77a7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:28.618076 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f522eaf8-da64-46af-ad82-817fac6d77a7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:28.640358 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7918a4e4-44b8-4345-9c6a-fcaf5ef011f5 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:28.641046 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7918a4e4-44b8-4345-9c6a-fcaf5ef011f5 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: 32ec744c-95d9-4999-a7fe-8c884dfe1a05] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:28.649020 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7918a4e4-44b8-4345-9c6a-fcaf5ef011f5 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:28.649589 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7918a4e4-44b8-4345-9c6a-fcaf5ef011f5 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:28.650328 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7918a4e4-44b8-4345-9c6a-fcaf5ef011f5 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:28.650766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7918a4e4-44b8-4345-9c6a-fcaf5ef011f5 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:28.867817 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f522eaf8-da64-46af-ad82-817fac6d77a7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:28.880938 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f522eaf8-da64-46af-ad82-817fac6d77a7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.287240 May 19 06:33:28.882324 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 158/306] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:28 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:28.919215 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7918a4e4-44b8-4345-9c6a-fcaf5ef011f5 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:28.951885 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7918a4e4-44b8-4345-9c6a-fcaf5ef011f5 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05" status: 200 len: 1314 microversion: 2.1 time: 0.315120 May 19 06:33:28.953832 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 149/307] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:28 2022] GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:33:29.034891 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-1c9c4c1f-25b9-4c03-a329-684cd71e2666 req-671f2362-c421-486b-acbb-a2e18997cda0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32ec744c-95d9-4999-a7fe-8c884dfe1a05", "name": "network-vif-plugged", "status": "completed", "tag": "3c7095f0-e36d-4777-bd29-b6064d1fc76d"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:33:29.055263 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-1c9c4c1f-25b9-4c03-a329-684cd71e2666 req-671f2362-c421-486b-acbb-a2e18997cda0 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:29.059525 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-1c9c4c1f-25b9-4c03-a329-684cd71e2666 req-671f2362-c421-486b-acbb-a2e18997cda0 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:29.090436 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-1c9c4c1f-25b9-4c03-a329-684cd71e2666 req-671f2362-c421-486b-acbb-a2e18997cda0 service nova] Creating event network-vif-plugged:3c7095f0-e36d-4777-bd29-b6064d1fc76d for instance 32ec744c-95d9-4999-a7fe-8c884dfe1a05 on hv-cinder-83699 May 19 06:33:29.102822 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-1c9c4c1f-25b9-4c03-a329-684cd71e2666 req-671f2362-c421-486b-acbb-a2e18997cda0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072336 May 19 06:33:29.106388 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 159/308] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:33:29.420243 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-bd3238a1-2f7e-4eb9-82b6-68fa313788d5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:29.421236 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-bd3238a1-2f7e-4eb9-82b6-68fa313788d5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:29.439252 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bd3238a1-2f7e-4eb9-82b6-68fa313788d5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:29.446195 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bd3238a1-2f7e-4eb9-82b6-68fa313788d5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:29.449230 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bd3238a1-2f7e-4eb9-82b6-68fa313788d5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:29.451118 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bd3238a1-2f7e-4eb9-82b6-68fa313788d5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:29.459405 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=100 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:33:29.565354 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-230a41c5-5957-4a3f-b985-d8b7b2e12eea tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:29.566178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-230a41c5-5957-4a3f-b985-d8b7b2e12eea tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] [instance: d5d1dc9d-8cc9-48b5-b7ec-34535b051b30] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:29.581782 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-230a41c5-5957-4a3f-b985-d8b7b2e12eea tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:29.582277 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-230a41c5-5957-4a3f-b985-d8b7b2e12eea tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:29.583280 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-230a41c5-5957-4a3f-b985-d8b7b2e12eea tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:29.587248 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-230a41c5-5957-4a3f-b985-d8b7b2e12eea tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:29.774209 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-bd3238a1-2f7e-4eb9-82b6-68fa313788d5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:29.793693 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-bd3238a1-2f7e-4eb9-82b6-68fa313788d5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd" status: 200 len: 1367 microversion: 2.1 time: 0.378802 May 19 06:33:29.799961 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 150/309] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:29 2022] GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd => generated 1367 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:29.902052 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9d355ccb-c307-41d5-9a62-17ea51378487 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:29.902761 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9d355ccb-c307-41d5-9a62-17ea51378487 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:29.917853 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9d355ccb-c307-41d5-9a62-17ea51378487 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:29.920049 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9d355ccb-c307-41d5-9a62-17ea51378487 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:29.921959 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9d355ccb-c307-41d5-9a62-17ea51378487 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:29.922416 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9d355ccb-c307-41d5-9a62-17ea51378487 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:30.233881 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-230a41c5-5957-4a3f-b985-d8b7b2e12eea tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d720bb1f5c4336a394c413d9d1c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beaccf2315245ec8959a58d23ebd293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:30.249429 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-230a41c5-5957-4a3f-b985-d8b7b2e12eea tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] 10.222.0.65 "GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30" status: 200 len: 1471 microversion: 2.1 time: 0.688942 May 19 06:33:30.250712 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 160/310] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:29 2022] GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 => generated 1471 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:30.257081 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-26067326-a308-4203-aae6-38d4c3919ca0 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:30.258310 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-26067326-a308-4203-aae6-38d4c3919ca0 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: 32ec744c-95d9-4999-a7fe-8c884dfe1a05] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:30.266005 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-26067326-a308-4203-aae6-38d4c3919ca0 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:30.266680 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-26067326-a308-4203-aae6-38d4c3919ca0 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:30.267452 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-26067326-a308-4203-aae6-38d4c3919ca0 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:30.267929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-26067326-a308-4203-aae6-38d4c3919ca0 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:30.296676 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9d355ccb-c307-41d5-9a62-17ea51378487 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:30.311197 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9d355ccb-c307-41d5-9a62-17ea51378487 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.411555 May 19 06:33:30.311820 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 151/311] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:29 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:30.650818 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-26067326-a308-4203-aae6-38d4c3919ca0 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:30.660997 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-26067326-a308-4203-aae6-38d4c3919ca0 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05" status: 200 len: 1314 microversion: 2.1 time: 0.408895 May 19 06:33:30.663839 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 161/312] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:30 2022] GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05 => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:30.818723 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-24cdbc5d-c76c-42c0-bab9-5c880c8e7ab2 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:30.820677 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-24cdbc5d-c76c-42c0-bab9-5c880c8e7ab2 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:30.840625 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-24cdbc5d-c76c-42c0-bab9-5c880c8e7ab2 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:30.841683 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-24cdbc5d-c76c-42c0-bab9-5c880c8e7ab2 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:30.851645 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-24cdbc5d-c76c-42c0-bab9-5c880c8e7ab2 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:30.852234 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-24cdbc5d-c76c-42c0-bab9-5c880c8e7ab2 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:30.856927 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-2a0d27a4-6ff0-4ba9-a315-9c3efaabc7b2 req-330a435d-6eb9-4240-bd49-f65c16140566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d1dc9d-8cc9-48b5-b7ec-34535b051b30", "name": "network-vif-deleted", "tag": "58286b94-de20-44e2-b14e-60bc473bc84e"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:33:30.869596 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-2a0d27a4-6ff0-4ba9-a315-9c3efaabc7b2 req-330a435d-6eb9-4240-bd49-f65c16140566 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:30.870155 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-2a0d27a4-6ff0-4ba9-a315-9c3efaabc7b2 req-330a435d-6eb9-4240-bd49-f65c16140566 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:30.899775 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-2a0d27a4-6ff0-4ba9-a315-9c3efaabc7b2 req-330a435d-6eb9-4240-bd49-f65c16140566 service nova] Creating event network-vif-deleted:58286b94-de20-44e2-b14e-60bc473bc84e for instance d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 on hv-cinder-83699 May 19 06:33:30.907680 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-2a0d27a4-6ff0-4ba9-a315-9c3efaabc7b2 req-330a435d-6eb9-4240-bd49-f65c16140566 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056010 May 19 06:33:30.909383 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 162/313] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:33:31.106242 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-24cdbc5d-c76c-42c0-bab9-5c880c8e7ab2 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:31.116013 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-24cdbc5d-c76c-42c0-bab9-5c880c8e7ab2 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd" status: 200 len: 1367 microversion: 2.1 time: 0.301877 May 19 06:33:31.116929 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 152/314] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:30 2022] GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd => generated 1367 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:31.208516 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-d4dfccc5-88e5-4312-8a8a-5dfea8c41465 req-312ca98e-3394-4a7a-9207-1864e2b9194c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d1dc9d-8cc9-48b5-b7ec-34535b051b30", "name": "network-vif-unplugged", "status": "completed", "tag": "58286b94-de20-44e2-b14e-60bc473bc84e"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:33:31.228472 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-d4dfccc5-88e5-4312-8a8a-5dfea8c41465 req-312ca98e-3394-4a7a-9207-1864e2b9194c service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:31.229675 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-d4dfccc5-88e5-4312-8a8a-5dfea8c41465 req-312ca98e-3394-4a7a-9207-1864e2b9194c service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:31.254896 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-d4dfccc5-88e5-4312-8a8a-5dfea8c41465 req-312ca98e-3394-4a7a-9207-1864e2b9194c service nova] Creating event network-vif-unplugged:58286b94-de20-44e2-b14e-60bc473bc84e for instance d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 on hv-cinder-83699 May 19 06:33:31.265322 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-d4dfccc5-88e5-4312-8a8a-5dfea8c41465 req-312ca98e-3394-4a7a-9207-1864e2b9194c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068230 May 19 06:33:31.266251 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 163/315] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:33:31.273540 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a7998461-a4b3-4532-887e-187ab7a3c606 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:31.276213 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a7998461-a4b3-4532-887e-187ab7a3c606 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] [instance: d5d1dc9d-8cc9-48b5-b7ec-34535b051b30] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:31.285719 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a7998461-a4b3-4532-887e-187ab7a3c606 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:31.286382 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a7998461-a4b3-4532-887e-187ab7a3c606 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:31.287765 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a7998461-a4b3-4532-887e-187ab7a3c606 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:31.288277 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a7998461-a4b3-4532-887e-187ab7a3c606 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:31.339207 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-dd2783b7-881b-4d82-a9a3-d33965e622d8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:31.345772 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-dd2783b7-881b-4d82-a9a3-d33965e622d8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:31.365543 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dd2783b7-881b-4d82-a9a3-d33965e622d8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:31.366026 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dd2783b7-881b-4d82-a9a3-d33965e622d8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:31.366870 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dd2783b7-881b-4d82-a9a3-d33965e622d8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:31.367312 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dd2783b7-881b-4d82-a9a3-d33965e622d8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:31.469115 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a7998461-a4b3-4532-887e-187ab7a3c606 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d720bb1f5c4336a394c413d9d1c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beaccf2315245ec8959a58d23ebd293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:31.479972 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a7998461-a4b3-4532-887e-187ab7a3c606 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] 10.222.0.65 "GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30" status: 200 len: 1429 microversion: 2.1 time: 0.215507 May 19 06:33:31.485555 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 153/316] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:31 2022] GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 => generated 1429 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:31.654722 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-dd2783b7-881b-4d82-a9a3-d33965e622d8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:31.664050 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-dd2783b7-881b-4d82-a9a3-d33965e622d8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.337358 May 19 06:33:31.664968 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 164/317] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:31 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:31.682923 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f4233d35-3b8c-45bf-85fd-6d4543a05a68 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:31.683540 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f4233d35-3b8c-45bf-85fd-6d4543a05a68 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: 32ec744c-95d9-4999-a7fe-8c884dfe1a05] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:31.691556 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f4233d35-3b8c-45bf-85fd-6d4543a05a68 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:31.692267 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f4233d35-3b8c-45bf-85fd-6d4543a05a68 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:31.693225 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f4233d35-3b8c-45bf-85fd-6d4543a05a68 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:31.694454 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f4233d35-3b8c-45bf-85fd-6d4543a05a68 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:32.104910 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f4233d35-3b8c-45bf-85fd-6d4543a05a68 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:32.115802 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f4233d35-3b8c-45bf-85fd-6d4543a05a68 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05" status: 200 len: 1314 microversion: 2.1 time: 0.438452 May 19 06:33:32.126812 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 154/318] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:31 2022] GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:32.147848 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b8ca38ab-7cf3-48d4-9d47-94ffe8a38d55 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:32.148468 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b8ca38ab-7cf3-48d4-9d47-94ffe8a38d55 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:32.156158 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b8ca38ab-7cf3-48d4-9d47-94ffe8a38d55 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:32.157034 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b8ca38ab-7cf3-48d4-9d47-94ffe8a38d55 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:32.158147 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b8ca38ab-7cf3-48d4-9d47-94ffe8a38d55 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:32.158883 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b8ca38ab-7cf3-48d4-9d47-94ffe8a38d55 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:32.503926 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f548b767-11da-4f71-b774-2e7c8067a014 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:32.504652 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f548b767-11da-4f71-b774-2e7c8067a014 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] [instance: d5d1dc9d-8cc9-48b5-b7ec-34535b051b30] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:32.516346 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f548b767-11da-4f71-b774-2e7c8067a014 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:32.517078 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f548b767-11da-4f71-b774-2e7c8067a014 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:32.519849 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f548b767-11da-4f71-b774-2e7c8067a014 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:32.520520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f548b767-11da-4f71-b774-2e7c8067a014 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:32.547780 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-f548b767-11da-4f71-b774-2e7c8067a014 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] HTTP exception thrown: Instance d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 could not be found. May 19 06:33:32.551840 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f548b767-11da-4f71-b774-2e7c8067a014 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Request method failure captured: May 19 06:33:32.551840 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 HTTP/1.1 May 19 06:33:32.551840 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept: application/json May 19 06:33:32.551840 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity May 19 06:33:32.551840 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Connection: close May 19 06:33:32.551840 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Length: 0 May 19 06:33:32.551840 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Type: application/json May 19 06:33:32.551840 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Host: 10.222.0.65 May 19 06:33:32.551840 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None May 19 06:33:32.551840 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 May 19 06:33:32.551840 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiheSZjB8c46bFA3VJLseMDHLo2c5F6d_TprfEBuogYauunP9ZQSYos0Zxm9Fxn19tSZ6fXR5dBSmzAXXYVfAFJvTFFZSh7DOQJnt-ZCq6FZBwECZa5JFWFSby3zlRmStWnbFdWz-z1MD_bZHfeoclUZRNV0tI9usnJbsEeg4g53Q0lyk May 19 06:33:32.551840 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Id: None May 19 06:33:32.551840 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Name: None May 19 06:33:32.551840 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed May 19 06:33:32.551840 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True May 19 06:33:32.551840 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default May 19 06:33:32.551840 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default May 19 06:33:32.551840 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Id: 8beaccf2315245ec8959a58d23ebd293 May 19 06:33:32.551840 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-VolumesNegativeTest-1153468709 May 19 06:33:32.551840 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Role: reader,member May 19 06:33:32.551840 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Roles: reader,member May 19 06:33:32.554894 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8beaccf2315245ec8959a58d23ebd293"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8beaccf2315245ec8959a58d23ebd293"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8beaccf2315245ec8959a58d23ebd293"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8beaccf2315245ec8959a58d23ebd293", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:33:32.554894 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-VolumesNegativeTest-1153468709 May 19 06:33:32.554894 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Id: 8beaccf2315245ec8959a58d23ebd293 May 19 06:33:32.554894 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-VolumesNegativeTest-1153468709 May 19 06:33:32.554894 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User: tempest-VolumesNegativeTest-1153468709-project May 19 06:33:32.554894 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default May 19 06:33:32.554894 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default May 19 06:33:32.554894 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Id: b4d720bb1f5c4336a394c413d9d1c612 May 19 06:33:32.554894 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-VolumesNegativeTest-1153468709-project May 19 06:33:32.554894 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: method: > May 19 06:33:32.554894 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: exception: Instance d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 could not be found. May 19 06:33:32.554894 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: action_args: {'id': 'd5d1dc9d-8cc9-48b5-b7ec-34535b051b30'} May 19 06:33:32.556742 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:33:32.556742 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:33:32.556742 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:33:32.556742 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:33:32.556742 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:33:32.556742 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:33:32.556742 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:33:32.556742 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:33:32.556742 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:33:32.556742 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:33:32.556742 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 could not be found. May 19 06:33:32.556742 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:33:32.556742 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:33:32.556742 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:33:32.556742 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:33:32.556742 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:33:32.556742 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:33:32.556742 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:33:32.556742 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:33:32.556742 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:33:32.560244 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:33:32.560244 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:33:32.560244 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:33:32.560244 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:33:32.560244 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:33:32.560244 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:33:32.560244 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:33:32.560244 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 could not be found. May 19 06:33:32.560244 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:33:32.560244 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:33:32.560244 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:33:32.560244 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:33:32.560244 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:33:32.560244 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:33:32.560244 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:33:32.560244 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:33:32.560244 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 could not be found. May 19 06:33:32.560244 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:33:32.578641 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f548b767-11da-4f71-b774-2e7c8067a014 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] Returning 404 to user: Instance d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:33:32.578641 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f548b767-11da-4f71-b774-2e7c8067a014 tempest-VolumesNegativeTest-1153468709 tempest-VolumesNegativeTest-1153468709-project] 10.222.0.65 "GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30" status: 404 len: 111 microversion: 2.1 time: 0.064138 May 19 06:33:32.578641 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 155/319] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:32 2022] GET /compute/v2.1/servers/d5d1dc9d-8cc9-48b5-b7ec-34535b051b30 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 06:33:32.593098 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b8ca38ab-7cf3-48d4-9d47-94ffe8a38d55 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:32.593618 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b8ca38ab-7cf3-48d4-9d47-94ffe8a38d55 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd" status: 200 len: 1367 microversion: 2.1 time: 0.450751 May 19 06:33:32.605332 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 165/320] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:32 2022] GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd => generated 1367 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:32.605559 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b320c3ec-1b84-446f-94f5-0a47a1b85be2 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:33:32.605559 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b320c3ec-1b84-446f-94f5-0a47a1b85be2 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:32.605559 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b320c3ec-1b84-446f-94f5-0a47a1b85be2 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:32.698621 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a93d43a3-2bcb-4c5a-ac72-212f9f125aea tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:32.699252 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a93d43a3-2bcb-4c5a-ac72-212f9f125aea tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:32.714838 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:33:32.725739 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a93d43a3-2bcb-4c5a-ac72-212f9f125aea tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:32.727266 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a93d43a3-2bcb-4c5a-ac72-212f9f125aea tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:32.735218 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a93d43a3-2bcb-4c5a-ac72-212f9f125aea tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:32.736197 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a93d43a3-2bcb-4c5a-ac72-212f9f125aea tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:32.780176 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b320c3ec-1b84-446f-94f5-0a47a1b85be2 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Going to try to stop instance {{(pid=117712) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 06:33:32.904120 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b320c3ec-1b84-446f-94f5-0a47a1b85be2 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "POST /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac/action" status: 202 len: 0 microversion: 2.1 time: 0.312672 May 19 06:33:32.910374 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 156/321] 10.222.0.65 () {60 vars in 1277 bytes} [Thu May 19 06:33:32 2022] POST /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 06:33:32.921959 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-96414a85-1f34-4c7c-a3c0-acab2995306b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:32.927056 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-96414a85-1f34-4c7c-a3c0-acab2995306b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:32.943591 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-96414a85-1f34-4c7c-a3c0-acab2995306b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:32.944056 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-96414a85-1f34-4c7c-a3c0-acab2995306b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:32.946519 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-96414a85-1f34-4c7c-a3c0-acab2995306b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:32.951994 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-96414a85-1f34-4c7c-a3c0-acab2995306b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:33.248261 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a93d43a3-2bcb-4c5a-ac72-212f9f125aea tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:33.266047 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a93d43a3-2bcb-4c5a-ac72-212f9f125aea tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.579619 May 19 06:33:33.266723 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 166/322] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:32 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:33:33.280813 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-73580b02-4f72-4805-8d91-f85ad185bdef tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:33.281757 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-73580b02-4f72-4805-8d91-f85ad185bdef tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: 32ec744c-95d9-4999-a7fe-8c884dfe1a05] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:33.294833 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-73580b02-4f72-4805-8d91-f85ad185bdef tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:33.295556 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-73580b02-4f72-4805-8d91-f85ad185bdef tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:33.302276 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-73580b02-4f72-4805-8d91-f85ad185bdef tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:33.303554 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-73580b02-4f72-4805-8d91-f85ad185bdef tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:33.414385 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-96414a85-1f34-4c7c-a3c0-acab2995306b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:33.469276 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-96414a85-1f34-4c7c-a3c0-acab2995306b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1725 microversion: 2.1 time: 0.548216 May 19 06:33:33.481306 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 157/323] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:32 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1725 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:33.626717 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ddb8add9-0d7b-4a73-957b-e6b9dab5be56 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:33.628257 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ddb8add9-0d7b-4a73-957b-e6b9dab5be56 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:33.644340 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ddb8add9-0d7b-4a73-957b-e6b9dab5be56 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:33.645894 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ddb8add9-0d7b-4a73-957b-e6b9dab5be56 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:33.648099 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ddb8add9-0d7b-4a73-957b-e6b9dab5be56 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:33.651515 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ddb8add9-0d7b-4a73-957b-e6b9dab5be56 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:33.694129 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-73580b02-4f72-4805-8d91-f85ad185bdef tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:33.718529 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-73580b02-4f72-4805-8d91-f85ad185bdef tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05" status: 200 len: 1314 microversion: 2.1 time: 0.437308 May 19 06:33:33.719235 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 167/324] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:33 2022] GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05 => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:34.304393 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-dabb7fc8-2a18-4f14-866a-0ef81b075473 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:34.305561 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-dabb7fc8-2a18-4f14-866a-0ef81b075473 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:34.332263 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dabb7fc8-2a18-4f14-866a-0ef81b075473 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:34.333107 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dabb7fc8-2a18-4f14-866a-0ef81b075473 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:34.334610 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dabb7fc8-2a18-4f14-866a-0ef81b075473 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:34.335423 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dabb7fc8-2a18-4f14-866a-0ef81b075473 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:34.530852 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ddb8add9-0d7b-4a73-957b-e6b9dab5be56 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:34.548037 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ddb8add9-0d7b-4a73-957b-e6b9dab5be56 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd" status: 200 len: 1367 microversion: 2.1 time: 0.929545 May 19 06:33:34.548656 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 158/325] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:33 2022] GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd => generated 1367 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:34.568795 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-245d3d95-a92e-4397-89b9-2770b8cf01d6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:34.568795 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-245d3d95-a92e-4397-89b9-2770b8cf01d6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:34.578494 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-245d3d95-a92e-4397-89b9-2770b8cf01d6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:34.582811 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-245d3d95-a92e-4397-89b9-2770b8cf01d6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:34.583981 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-245d3d95-a92e-4397-89b9-2770b8cf01d6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:34.598132 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-245d3d95-a92e-4397-89b9-2770b8cf01d6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:34.843860 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-dabb7fc8-2a18-4f14-866a-0ef81b075473 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:34.854167 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-dabb7fc8-2a18-4f14-866a-0ef81b075473 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1500 microversion: 2.1 time: 0.557656 May 19 06:33:34.855991 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 168/326] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:34 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1500 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:34.863052 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1ebfd913-1d5f-4c47-82c2-ce5ce6144e63 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:34.863937 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-1ebfd913-1d5f-4c47-82c2-ce5ce6144e63 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: 32ec744c-95d9-4999-a7fe-8c884dfe1a05] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:34.882141 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1ebfd913-1d5f-4c47-82c2-ce5ce6144e63 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:34.884657 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1ebfd913-1d5f-4c47-82c2-ce5ce6144e63 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:34.886795 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1ebfd913-1d5f-4c47-82c2-ce5ce6144e63 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:34.887642 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1ebfd913-1d5f-4c47-82c2-ce5ce6144e63 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:35.334171 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1ebfd913-1d5f-4c47-82c2-ce5ce6144e63 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:35.345741 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-1ebfd913-1d5f-4c47-82c2-ce5ce6144e63 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05" status: 200 len: 1499 microversion: 2.1 time: 0.488351 May 19 06:33:35.350364 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 169/327] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:34 2022] GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05 => generated 1499 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:35.371746 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-fe95d074-60dc-4c37-8a7d-f81f33bc123a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7df2c15-77dc-48f1-9b76-4b11b3612b6f"}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:33:35.373130 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-fe95d074-60dc-4c37-8a7d-f81f33bc123a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:35.394416 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fe95d074-60dc-4c37-8a7d-f81f33bc123a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:35.410175 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fe95d074-60dc-4c37-8a7d-f81f33bc123a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:35.411030 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fe95d074-60dc-4c37-8a7d-f81f33bc123a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:35.411481 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fe95d074-60dc-4c37-8a7d-f81f33bc123a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:35.526551 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-fe95d074-60dc-4c37-8a7d-f81f33bc123a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] HTTP exception thrown: Cannot 'attach_volume' instance 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e while it is in vm_state rescued May 19 06:33:35.528614 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-fe95d074-60dc-4c37-8a7d-f81f33bc123a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Request method failure captured: May 19 06:33:35.528614 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: POST /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e/os-volume_attachments HTTP/1.1 May 19 06:33:35.528614 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:33:35.528614 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:33:35.528614 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:33:35.528614 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 74 May 19 06:33:35.528614 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:33:35.528614 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:33:35.528614 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:33:35.528614 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:33:35.528614 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheQuT8V1GDiMH0DOO30Tfiq0zqgfOKtmbZZVfRuQfUb8iaIztwspeMTxkuDLD2JCWzCPycgw0CBN7_rmViHiNTGxyVziGruF8U08SJ90dqoSpsfL2qSZ-4DDY3yRLv9LzIxqZGYSN8qlP4jViuesPcXSDJ7XSg52MZEFyD7v7uiamXU May 19 06:33:35.528614 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:33:35.528614 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:33:35.528614 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:33:35.528614 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:33:35.528614 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:33:35.528614 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:33:35.528614 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: 35cb15f2075c41889b91291b645170a5 May 19 06:33:35.528614 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-802710311 May 19 06:33:35.528614 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:33:35.528614 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:33:35.530250 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/35cb15f2075c41889b91291b645170a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/35cb15f2075c41889b91291b645170a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/35cb15f2075c41889b91291b645170a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_35cb15f2075c41889b91291b645170a5", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:33:35.530250 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-ServerRescueNegativeTestJSON-802710311 May 19 06:33:35.530250 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: 35cb15f2075c41889b91291b645170a5 May 19 06:33:35.530250 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-802710311 May 19 06:33:35.530250 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-ServerRescueNegativeTestJSON-802710311-project May 19 06:33:35.530250 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:33:35.530250 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:33:35.530250 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: 6a71c3c016564c3b9ab0b6b58d378fda May 19 06:33:35.530250 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-ServerRescueNegativeTestJSON-802710311-project May 19 06:33:35.530250 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: May 19 06:33:35.530250 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {"volumeAttachment": {"volumeId": "c7df2c15-77dc-48f1-9b76-4b11b3612b6f"}} May 19 06:33:35.530250 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: > May 19 06:33:35.531305 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Cannot 'attach_volume' instance 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e while it is in vm_state rescued May 19 06:33:35.531305 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'server_id': '8f4202e4-0d0b-4d78-b9e3-a8e529700d8e', 'body': {'volumeAttachment': {'volumeId': 'c7df2c15-77dc-48f1-9b76-4b11b3612b6f'}}} May 19 06:33:35.531305 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:33:35.531305 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:33:35.531305 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 19 06:33:35.531305 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 19 06:33:35.531305 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 06:33:35.531305 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 06:33:35.531305 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 06:33:35.531305 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 06:33:35.531305 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e in vm_state rescued. Cannot attach_volume while the instance is in this state. May 19 06:33:35.531305 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:33:35.531305 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:33:35.531305 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:33:35.531305 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:33:35.531305 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:33:35.531305 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:33:35.531305 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:33:35.531305 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:33:35.532632 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:33:35.532632 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:33:35.532632 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 06:33:35.532632 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 06:33:35.532632 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 06:33:35.532632 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 06:33:35.532632 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 06:33:35.532632 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 06:33:35.532632 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 19 06:33:35.532632 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 06:33:35.532632 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 06:33:35.532632 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 06:33:35.532632 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e while it is in vm_state rescued May 19 06:33:35.532632 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:33:35.532632 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:33:35.532632 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:33:35.532632 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:33:35.532632 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:33:35.532632 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:33:35.534207 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:33:35.534207 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:33:35.534207 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e while it is in vm_state rescued May 19 06:33:35.534207 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:33:35.537822 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-fe95d074-60dc-4c37-8a7d-f81f33bc123a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Returning 409 to user: Cannot 'attach_volume' instance 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e while it is in vm_state rescued {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:33:35.538990 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-fe95d074-60dc-4c37-8a7d-f81f33bc123a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "POST /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.185157 May 19 06:33:35.539773 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 170/328] 10.222.0.65 () {60 vars in 1322 bytes} [Thu May 19 06:33:35 2022] POST /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e/os-volume_attachments => generated 152 bytes in 189 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 06:33:35.550769 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3d951df4-0238-4c6d-9eb6-9d61bedeb014 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:33:35.552079 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-3d951df4-0238-4c6d-9eb6-9d61bedeb014 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:35.561087 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3d951df4-0238-4c6d-9eb6-9d61bedeb014 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:35.561676 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3d951df4-0238-4c6d-9eb6-9d61bedeb014 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:35.562537 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3d951df4-0238-4c6d-9eb6-9d61bedeb014 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:35.563035 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3d951df4-0238-4c6d-9eb6-9d61bedeb014 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:35.692435 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-3d951df4-0238-4c6d-9eb6-9d61bedeb014 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "POST /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e/action" status: 202 len: 0 microversion: 2.1 time: 0.145425 May 19 06:33:35.693398 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 171/329] 10.222.0.65 () {60 vars in 1277 bytes} [Thu May 19 06:33:35 2022] POST /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 06:33:35.702151 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-664fee81-1b11-4958-96fb-ddaa386349ed tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:35.702879 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-664fee81-1b11-4958-96fb-ddaa386349ed tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:35.725530 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-245d3d95-a92e-4397-89b9-2770b8cf01d6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:35.736062 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-664fee81-1b11-4958-96fb-ddaa386349ed tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:35.742560 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-664fee81-1b11-4958-96fb-ddaa386349ed tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:35.743692 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-664fee81-1b11-4958-96fb-ddaa386349ed tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:35.744297 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-664fee81-1b11-4958-96fb-ddaa386349ed tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:35.755137 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-245d3d95-a92e-4397-89b9-2770b8cf01d6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1725 microversion: 2.1 time: 1.205047 May 19 06:33:35.761459 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 159/330] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:34 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1725 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:35.791192 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f284d352-b0c8-4581-9bd2-770347e53b01 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:35.792290 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f284d352-b0c8-4581-9bd2-770347e53b01 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:35.820576 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f284d352-b0c8-4581-9bd2-770347e53b01 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:35.822842 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f284d352-b0c8-4581-9bd2-770347e53b01 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:35.825304 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f284d352-b0c8-4581-9bd2-770347e53b01 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:35.826714 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f284d352-b0c8-4581-9bd2-770347e53b01 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:36.261547 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-664fee81-1b11-4958-96fb-ddaa386349ed tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:36.279145 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-664fee81-1b11-4958-96fb-ddaa386349ed tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd" status: 200 len: 1367 microversion: 2.1 time: 0.584219 May 19 06:33:36.279735 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 172/331] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:35 2022] GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd => generated 1367 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:36.336151 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-31946579-76ee-4167-b324-332512d64186 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:36.336899 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-31946579-76ee-4167-b324-332512d64186 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: 32ec744c-95d9-4999-a7fe-8c884dfe1a05] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:36.361210 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-31946579-76ee-4167-b324-332512d64186 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:36.365148 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-31946579-76ee-4167-b324-332512d64186 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:36.369373 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-31946579-76ee-4167-b324-332512d64186 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:36.374356 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-31946579-76ee-4167-b324-332512d64186 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:36.448241 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-31946579-76ee-4167-b324-332512d64186 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: 32ec744c-95d9-4999-a7fe-8c884dfe1a05] Going to try to terminate instance {{(pid=117711) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 06:33:36.503774 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:33:36.540935 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f284d352-b0c8-4581-9bd2-770347e53b01 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:36.551077 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f284d352-b0c8-4581-9bd2-770347e53b01 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1508 microversion: 2.1 time: 0.787762 May 19 06:33:36.551698 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 160/332] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:35 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1508 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:36.614636 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-31946579-76ee-4167-b324-332512d64186 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "DELETE /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05" status: 204 len: 0 microversion: 2.1 time: 0.286453 May 19 06:33:36.621352 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 173/333] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 06:33:36 2022] DELETE /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 06:33:36.627354 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ec7741aa-2c08-48cc-801c-a3a3c8a49a45 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:36.628325 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ec7741aa-2c08-48cc-801c-a3a3c8a49a45 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: 32ec744c-95d9-4999-a7fe-8c884dfe1a05] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:36.641419 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ec7741aa-2c08-48cc-801c-a3a3c8a49a45 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:36.645470 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ec7741aa-2c08-48cc-801c-a3a3c8a49a45 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:36.646877 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ec7741aa-2c08-48cc-801c-a3a3c8a49a45 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:36.648477 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ec7741aa-2c08-48cc-801c-a3a3c8a49a45 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:36.778251 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1a83266b-9932-4d2e-84f8-43ab93acd5ba tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:36.779425 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-1a83266b-9932-4d2e-84f8-43ab93acd5ba tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:36.799172 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1a83266b-9932-4d2e-84f8-43ab93acd5ba tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:36.799976 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1a83266b-9932-4d2e-84f8-43ab93acd5ba tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:36.805908 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1a83266b-9932-4d2e-84f8-43ab93acd5ba tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:36.807350 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1a83266b-9932-4d2e-84f8-43ab93acd5ba tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:36.958445 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ec7741aa-2c08-48cc-801c-a3a3c8a49a45 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:36.976408 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ec7741aa-2c08-48cc-801c-a3a3c8a49a45 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05" status: 200 len: 1505 microversion: 2.1 time: 0.353067 May 19 06:33:36.977024 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 161/334] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:36 2022] GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05 => generated 1505 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:37.300246 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-50821b61-8af8-4e8c-8e00-e295a8668435 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:37.313873 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-50821b61-8af8-4e8c-8e00-e295a8668435 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:37.323546 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1a83266b-9932-4d2e-84f8-43ab93acd5ba tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:37.336775 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-1a83266b-9932-4d2e-84f8-43ab93acd5ba tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1725 microversion: 2.1 time: 0.563036 May 19 06:33:37.338675 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-50821b61-8af8-4e8c-8e00-e295a8668435 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:37.339388 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-50821b61-8af8-4e8c-8e00-e295a8668435 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:37.341054 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-50821b61-8af8-4e8c-8e00-e295a8668435 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:37.341909 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 174/335] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:36 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1725 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:37.342581 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-50821b61-8af8-4e8c-8e00-e295a8668435 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:37.524087 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-20d4dfd7-396a-47e7-a286-10c1b42d662e req-ca4067ac-7fa2-445d-aef4-ee1075569da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8943880-a4d3-49d5-8c02-88ff7343f5fd", "name": "network-vif-plugged", "status": "completed", "tag": "f34db898-32c0-4c35-871a-443b193021aa"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:33:37.542340 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-20d4dfd7-396a-47e7-a286-10c1b42d662e req-ca4067ac-7fa2-445d-aef4-ee1075569da5 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:37.543846 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-20d4dfd7-396a-47e7-a286-10c1b42d662e req-ca4067ac-7fa2-445d-aef4-ee1075569da5 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:37.581836 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-20d4dfd7-396a-47e7-a286-10c1b42d662e req-ca4067ac-7fa2-445d-aef4-ee1075569da5 service nova] Creating event network-vif-plugged:f34db898-32c0-4c35-871a-443b193021aa for instance e8943880-a4d3-49d5-8c02-88ff7343f5fd on hv-cinder-83699 May 19 06:33:37.592796 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-20d4dfd7-396a-47e7-a286-10c1b42d662e req-ca4067ac-7fa2-445d-aef4-ee1075569da5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080105 May 19 06:33:37.593874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 175/336] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:33:37.613551 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-449edbad-f116-477b-9c06-197e50e80ded tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:37.614306 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-449edbad-f116-477b-9c06-197e50e80ded tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:37.625778 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-449edbad-f116-477b-9c06-197e50e80ded tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:37.626293 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-449edbad-f116-477b-9c06-197e50e80ded tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:37.627269 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-449edbad-f116-477b-9c06-197e50e80ded tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:37.627855 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-449edbad-f116-477b-9c06-197e50e80ded tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:37.837597 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-50821b61-8af8-4e8c-8e00-e295a8668435 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:37.847698 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-50821b61-8af8-4e8c-8e00-e295a8668435 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd" status: 200 len: 1367 microversion: 2.1 time: 0.551458 May 19 06:33:37.858136 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 162/337] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:37 2022] GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd => generated 1367 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:37.943918 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-449edbad-f116-477b-9c06-197e50e80ded tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:37.959114 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-449edbad-f116-477b-9c06-197e50e80ded tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1508 microversion: 2.1 time: 0.349181 May 19 06:33:37.960027 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 176/338] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:37 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1508 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:37.995994 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-748a429a-f975-4c0a-aac4-0e86935a5479 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:37.996887 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-748a429a-f975-4c0a-aac4-0e86935a5479 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: 32ec744c-95d9-4999-a7fe-8c884dfe1a05] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:38.011534 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-748a429a-f975-4c0a-aac4-0e86935a5479 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:38.012190 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-748a429a-f975-4c0a-aac4-0e86935a5479 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:38.013147 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-748a429a-f975-4c0a-aac4-0e86935a5479 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:38.014763 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-748a429a-f975-4c0a-aac4-0e86935a5479 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:38.359093 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8fac43ee-ab58-4d1b-bc38-0c0f8bd74089 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:38.359711 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8fac43ee-ab58-4d1b-bc38-0c0f8bd74089 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:38.372754 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8fac43ee-ab58-4d1b-bc38-0c0f8bd74089 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:38.373201 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8fac43ee-ab58-4d1b-bc38-0c0f8bd74089 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:38.374039 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8fac43ee-ab58-4d1b-bc38-0c0f8bd74089 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:38.378467 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8fac43ee-ab58-4d1b-bc38-0c0f8bd74089 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:38.566022 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-748a429a-f975-4c0a-aac4-0e86935a5479 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:38.575991 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-748a429a-f975-4c0a-aac4-0e86935a5479 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05" status: 200 len: 1505 microversion: 2.1 time: 0.585656 May 19 06:33:38.577400 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 163/339] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:37 2022] GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05 => generated 1505 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:38.805480 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-8fac43ee-ab58-4d1b-bc38-0c0f8bd74089 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:38.816728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8fac43ee-ab58-4d1b-bc38-0c0f8bd74089 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1725 microversion: 2.1 time: 0.461853 May 19 06:33:38.817340 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 177/340] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:38 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1725 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:33:38.875731 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-785d7ec0-7e0e-4162-883c-090899cb18df tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:38.876475 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-785d7ec0-7e0e-4162-883c-090899cb18df tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:38.884306 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-785d7ec0-7e0e-4162-883c-090899cb18df tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:38.884842 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-785d7ec0-7e0e-4162-883c-090899cb18df tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:38.885847 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-785d7ec0-7e0e-4162-883c-090899cb18df tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:38.886722 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-785d7ec0-7e0e-4162-883c-090899cb18df tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:38.976173 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d91771ee-81e5-417e-9db2-57083c2c2451 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:38.977528 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d91771ee-81e5-417e-9db2-57083c2c2451 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:38.991311 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d91771ee-81e5-417e-9db2-57083c2c2451 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:38.992033 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d91771ee-81e5-417e-9db2-57083c2c2451 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:38.993017 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d91771ee-81e5-417e-9db2-57083c2c2451 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:38.993643 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d91771ee-81e5-417e-9db2-57083c2c2451 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:39.295675 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-785d7ec0-7e0e-4162-883c-090899cb18df tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:39.306773 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-785d7ec0-7e0e-4162-883c-090899cb18df tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd" status: 200 len: 1367 microversion: 2.1 time: 0.435571 May 19 06:33:39.307304 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 164/341] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:38 2022] GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd => generated 1367 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:39.324359 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-23072ca5-9128-41d3-a038-b20de17f432e req-7128f9b7-6445-48f1-b855-260210875083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32ec744c-95d9-4999-a7fe-8c884dfe1a05", "name": "network-vif-deleted", "tag": "3c7095f0-e36d-4777-bd29-b6064d1fc76d"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:33:39.363641 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-23072ca5-9128-41d3-a038-b20de17f432e req-7128f9b7-6445-48f1-b855-260210875083 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:39.364274 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-23072ca5-9128-41d3-a038-b20de17f432e req-7128f9b7-6445-48f1-b855-260210875083 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:39.387441 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-23072ca5-9128-41d3-a038-b20de17f432e req-7128f9b7-6445-48f1-b855-260210875083 service nova] Creating event network-vif-deleted:3c7095f0-e36d-4777-bd29-b6064d1fc76d for instance 32ec744c-95d9-4999-a7fe-8c884dfe1a05 on hv-cinder-83699 May 19 06:33:39.400705 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-23072ca5-9128-41d3-a038-b20de17f432e req-7128f9b7-6445-48f1-b855-260210875083 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079851 May 19 06:33:39.401575 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 165/342] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:33:39.423762 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d91771ee-81e5-417e-9db2-57083c2c2451 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:39.454519 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d91771ee-81e5-417e-9db2-57083c2c2451 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1508 microversion: 2.1 time: 0.480955 May 19 06:33:39.455162 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 178/343] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:38 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1508 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:39.595101 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a5f59ef5-dbaa-49b4-a44c-5ff9fb8743d8 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:39.598711 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a5f59ef5-dbaa-49b4-a44c-5ff9fb8743d8 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: 32ec744c-95d9-4999-a7fe-8c884dfe1a05] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:39.615549 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a5f59ef5-dbaa-49b4-a44c-5ff9fb8743d8 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:39.616001 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a5f59ef5-dbaa-49b4-a44c-5ff9fb8743d8 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:39.617994 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a5f59ef5-dbaa-49b4-a44c-5ff9fb8743d8 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:39.618437 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a5f59ef5-dbaa-49b4-a44c-5ff9fb8743d8 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:39.743833 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a5f59ef5-dbaa-49b4-a44c-5ff9fb8743d8 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:39.752605 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a5f59ef5-dbaa-49b4-a44c-5ff9fb8743d8 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05" status: 200 len: 1299 microversion: 2.1 time: 0.161332 May 19 06:33:39.753344 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 166/344] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:39 2022] GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05 => generated 1299 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:39.835389 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-52191a86-35bc-4951-b29e-440086d0302c tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:39.836196 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-52191a86-35bc-4951-b29e-440086d0302c tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:39.859019 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-52191a86-35bc-4951-b29e-440086d0302c tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:39.860199 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-52191a86-35bc-4951-b29e-440086d0302c tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:39.861034 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-52191a86-35bc-4951-b29e-440086d0302c tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:39.861555 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-52191a86-35bc-4951-b29e-440086d0302c tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:40.161967 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-52191a86-35bc-4951-b29e-440086d0302c tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:40.174701 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-52191a86-35bc-4951-b29e-440086d0302c tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1725 microversion: 2.1 time: 0.343050 May 19 06:33:40.178696 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 179/345] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:39 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1725 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:40.327468 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-677eb656-096c-4d78-989a-ec16cd4a3e61 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:40.329870 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-677eb656-096c-4d78-989a-ec16cd4a3e61 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:40.346403 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-677eb656-096c-4d78-989a-ec16cd4a3e61 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:40.347053 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-677eb656-096c-4d78-989a-ec16cd4a3e61 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:40.348004 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-677eb656-096c-4d78-989a-ec16cd4a3e61 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:40.348588 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-677eb656-096c-4d78-989a-ec16cd4a3e61 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:40.358959 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:33:40.473272 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f3ab4f10-adee-4f85-8281-91bf24b55c06 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:40.474866 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f3ab4f10-adee-4f85-8281-91bf24b55c06 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:40.492121 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f3ab4f10-adee-4f85-8281-91bf24b55c06 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:40.497962 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f3ab4f10-adee-4f85-8281-91bf24b55c06 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:40.499090 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f3ab4f10-adee-4f85-8281-91bf24b55c06 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:40.499698 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f3ab4f10-adee-4f85-8281-91bf24b55c06 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:40.658931 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-677eb656-096c-4d78-989a-ec16cd4a3e61 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:40.671258 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-677eb656-096c-4d78-989a-ec16cd4a3e61 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd" status: 200 len: 1556 microversion: 2.1 time: 0.350173 May 19 06:33:40.683717 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 167/346] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:40 2022] GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd => generated 1556 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:40.690231 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-fa7263cd-a651-4a3a-9c6e-5e79ca177320 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:40.691704 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-fa7263cd-a651-4a3a-9c6e-5e79ca177320 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:40.699538 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fa7263cd-a651-4a3a-9c6e-5e79ca177320 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:40.700233 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fa7263cd-a651-4a3a-9c6e-5e79ca177320 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:40.701152 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fa7263cd-a651-4a3a-9c6e-5e79ca177320 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:40.701776 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fa7263cd-a651-4a3a-9c6e-5e79ca177320 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:40.810162 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-fa7263cd-a651-4a3a-9c6e-5e79ca177320 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124193 May 19 06:33:40.810778 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 168/347] 10.222.0.65 () {58 vars in 1274 bytes} [Thu May 19 06:33:40 2022] GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:33:40.816162 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-71099798-04a3-480a-9d4d-9a79d9b67945 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:40.817120 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-71099798-04a3-480a-9d4d-9a79d9b67945 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: 32ec744c-95d9-4999-a7fe-8c884dfe1a05] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:40.839585 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-71099798-04a3-480a-9d4d-9a79d9b67945 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:40.843913 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-71099798-04a3-480a-9d4d-9a79d9b67945 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:40.845257 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-71099798-04a3-480a-9d4d-9a79d9b67945 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:40.848207 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-71099798-04a3-480a-9d4d-9a79d9b67945 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:40.909904 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:33:40.913448 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-71099798-04a3-480a-9d4d-9a79d9b67945 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:40.914995 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-71099798-04a3-480a-9d4d-9a79d9b67945 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:40.915750 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-71099798-04a3-480a-9d4d-9a79d9b67945 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lazy-loading 'fault' on Instance uuid 32ec744c-95d9-4999-a7fe-8c884dfe1a05 {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:33:41.089244 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-71099798-04a3-480a-9d4d-9a79d9b67945 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:41.104420 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-71099798-04a3-480a-9d4d-9a79d9b67945 tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05" status: 200 len: 1304 microversion: 2.1 time: 0.290011 May 19 06:33:41.107776 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 169/348] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:40 2022] GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05 => generated 1304 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:41.193787 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3995dd9a-1d7b-41d4-aa39-73e13ac70188 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:41.194404 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3995dd9a-1d7b-41d4-aa39-73e13ac70188 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:41.204765 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3995dd9a-1d7b-41d4-aa39-73e13ac70188 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:41.205974 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3995dd9a-1d7b-41d4-aa39-73e13ac70188 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:41.207741 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3995dd9a-1d7b-41d4-aa39-73e13ac70188 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:41.210992 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3995dd9a-1d7b-41d4-aa39-73e13ac70188 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:41.417359 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f3ab4f10-adee-4f85-8281-91bf24b55c06 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:41.427650 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f3ab4f10-adee-4f85-8281-91bf24b55c06 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1508 microversion: 2.1 time: 0.959827 May 19 06:33:41.440926 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 180/349] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:40 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1508 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:33:41.791888 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3995dd9a-1d7b-41d4-aa39-73e13ac70188 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:41.802852 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3995dd9a-1d7b-41d4-aa39-73e13ac70188 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1725 microversion: 2.1 time: 0.613325 May 19 06:33:41.804165 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 170/350] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:41 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1725 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:42.133497 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-56e41126-9a24-419b-a766-83179a817c6e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:42.135914 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-56e41126-9a24-419b-a766-83179a817c6e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: 32ec744c-95d9-4999-a7fe-8c884dfe1a05] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:42.152710 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-56e41126-9a24-419b-a766-83179a817c6e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:42.153159 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-56e41126-9a24-419b-a766-83179a817c6e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:42.155755 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-56e41126-9a24-419b-a766-83179a817c6e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:42.156984 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-56e41126-9a24-419b-a766-83179a817c6e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:42.219293 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-56e41126-9a24-419b-a766-83179a817c6e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:42.220184 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-56e41126-9a24-419b-a766-83179a817c6e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:42.220989 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-56e41126-9a24-419b-a766-83179a817c6e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lazy-loading 'fault' on Instance uuid 32ec744c-95d9-4999-a7fe-8c884dfe1a05 {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:33:42.344187 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-56e41126-9a24-419b-a766-83179a817c6e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2c7ead49a047c6bc04a783ed0bfc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af231f2d98544631857757d5b48fd918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:42.370017 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-56e41126-9a24-419b-a766-83179a817c6e tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05" status: 200 len: 1304 microversion: 2.1 time: 0.242418 May 19 06:33:42.380748 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 181/351] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:42 2022] GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05 => generated 1304 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:42.465548 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d455e842-4993-4470-a628-c58af98d3d78 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:42.466765 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d455e842-4993-4470-a628-c58af98d3d78 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:42.507270 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d455e842-4993-4470-a628-c58af98d3d78 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:42.507922 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d455e842-4993-4470-a628-c58af98d3d78 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:42.509255 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d455e842-4993-4470-a628-c58af98d3d78 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:42.510126 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d455e842-4993-4470-a628-c58af98d3d78 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:42.824216 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-08da3675-76a9-4b6e-9f2e-ed6de488780e tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:42.825214 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-08da3675-76a9-4b6e-9f2e-ed6de488780e tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:42.852091 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-08da3675-76a9-4b6e-9f2e-ed6de488780e tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:42.858713 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-08da3675-76a9-4b6e-9f2e-ed6de488780e tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:42.859640 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-08da3675-76a9-4b6e-9f2e-ed6de488780e tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:42.860108 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-08da3675-76a9-4b6e-9f2e-ed6de488780e tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:43.197132 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-08da3675-76a9-4b6e-9f2e-ed6de488780e tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:43.214103 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-08da3675-76a9-4b6e-9f2e-ed6de488780e tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1725 microversion: 2.1 time: 0.397012 May 19 06:33:43.220703 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 182/352] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:42 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1725 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:43.378598 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d455e842-4993-4470-a628-c58af98d3d78 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:43.399035 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e4a7c9e7-488a-4822-86b6-eb340e793f4b tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:43.400177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e4a7c9e7-488a-4822-86b6-eb340e793f4b tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] [instance: 32ec744c-95d9-4999-a7fe-8c884dfe1a05] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:43.404989 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d455e842-4993-4470-a628-c58af98d3d78 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1508 microversion: 2.1 time: 0.959417 May 19 06:33:43.407353 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 171/353] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:42 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1508 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:43.419544 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e4a7c9e7-488a-4822-86b6-eb340e793f4b tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:43.420362 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e4a7c9e7-488a-4822-86b6-eb340e793f4b tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:43.421341 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e4a7c9e7-488a-4822-86b6-eb340e793f4b tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:43.422069 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e4a7c9e7-488a-4822-86b6-eb340e793f4b tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:43.442277 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-e4a7c9e7-488a-4822-86b6-eb340e793f4b tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] HTTP exception thrown: Instance 32ec744c-95d9-4999-a7fe-8c884dfe1a05 could not be found. May 19 06:33:43.444217 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e4a7c9e7-488a-4822-86b6-eb340e793f4b tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Request method failure captured: May 19 06:33:43.444217 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05 HTTP/1.1 May 19 06:33:43.444217 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:33:43.444217 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:33:43.444217 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:33:43.444217 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 0 May 19 06:33:43.444217 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:33:43.444217 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:33:43.444217 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:33:43.444217 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:33:43.444217 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheR3w656dmNgLi9hZ0z-KvXs9zaqte7jd4p3h6onl1is7LI3_dQzVBK0__p5mtTGf95qz7YJONd8H5njuHv67vc3O4RaVG2a8IbMP_-X_KzfTcdYcyTamiQn6oYUCAJ7gclIyI3S_okuo4Jy989VATmm353xr8MnBYLj7-MyBxnjcKo May 19 06:33:43.444217 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:33:43.444217 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:33:43.444217 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:33:43.444217 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:33:43.444217 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:33:43.444217 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:33:43.444217 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: af231f2d98544631857757d5b48fd918 May 19 06:33:43.444217 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-VolumesActionsTest-572450892 May 19 06:33:43.444217 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:33:43.444217 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:33:43.445805 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/af231f2d98544631857757d5b48fd918"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/af231f2d98544631857757d5b48fd918"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/af231f2d98544631857757d5b48fd918"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_af231f2d98544631857757d5b48fd918", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:33:43.445805 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-VolumesActionsTest-572450892 May 19 06:33:43.445805 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: af231f2d98544631857757d5b48fd918 May 19 06:33:43.445805 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-VolumesActionsTest-572450892 May 19 06:33:43.445805 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-VolumesActionsTest-572450892-project May 19 06:33:43.445805 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:33:43.445805 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:33:43.445805 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: ce2c7ead49a047c6bc04a783ed0bfc43 May 19 06:33:43.445805 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-VolumesActionsTest-572450892-project May 19 06:33:43.445805 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: > May 19 06:33:43.445805 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Instance 32ec744c-95d9-4999-a7fe-8c884dfe1a05 could not be found. May 19 06:33:43.445805 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'id': '32ec744c-95d9-4999-a7fe-8c884dfe1a05'} May 19 06:33:43.446533 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:33:43.446533 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:33:43.446533 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:33:43.446533 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:33:43.446533 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:33:43.446533 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:33:43.446533 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:33:43.446533 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:33:43.446533 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:33:43.446533 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:33:43.446533 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32ec744c-95d9-4999-a7fe-8c884dfe1a05 could not be found. May 19 06:33:43.446533 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:33:43.446533 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:33:43.446533 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:33:43.446533 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:33:43.446533 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:33:43.446533 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:33:43.446533 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:33:43.446533 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:33:43.446533 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:33:43.447889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:33:43.447889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:33:43.447889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:33:43.447889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:33:43.447889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:33:43.447889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:33:43.447889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:33:43.447889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32ec744c-95d9-4999-a7fe-8c884dfe1a05 could not be found. May 19 06:33:43.447889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:33:43.447889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:33:43.447889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:33:43.447889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:33:43.447889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:33:43.447889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:33:43.447889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:33:43.447889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:33:43.447889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32ec744c-95d9-4999-a7fe-8c884dfe1a05 could not be found. May 19 06:33:43.447889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:33:43.449955 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e4a7c9e7-488a-4822-86b6-eb340e793f4b tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] Returning 404 to user: Instance 32ec744c-95d9-4999-a7fe-8c884dfe1a05 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:33:43.451386 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e4a7c9e7-488a-4822-86b6-eb340e793f4b tempest-VolumesActionsTest-572450892 tempest-VolumesActionsTest-572450892-project] 10.222.0.65 "GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05" status: 404 len: 111 microversion: 2.1 time: 0.066498 May 19 06:33:43.452595 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 183/354] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:43 2022] GET /compute/v2.1/servers/32ec744c-95d9-4999-a7fe-8c884dfe1a05 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:33:43.982489 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-e4be7ee9-51d5-48d7-a0d4-51174166c74a req-9c3c13cb-2606-4382-8c31-7736e075ddaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8943880-a4d3-49d5-8c02-88ff7343f5fd", "tag": "f34db898-32c0-4c35-871a-443b193021aa"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:33:43.997091 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-e4be7ee9-51d5-48d7-a0d4-51174166c74a req-9c3c13cb-2606-4382-8c31-7736e075ddaf service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:43.997566 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-e4be7ee9-51d5-48d7-a0d4-51174166c74a req-9c3c13cb-2606-4382-8c31-7736e075ddaf service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:44.010961 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-e4be7ee9-51d5-48d7-a0d4-51174166c74a req-9c3c13cb-2606-4382-8c31-7736e075ddaf service nova] Creating event network-changed:f34db898-32c0-4c35-871a-443b193021aa for instance e8943880-a4d3-49d5-8c02-88ff7343f5fd on hv-cinder-83699 May 19 06:33:44.016669 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-e4be7ee9-51d5-48d7-a0d4-51174166c74a req-9c3c13cb-2606-4382-8c31-7736e075ddaf service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038172 May 19 06:33:44.018201 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 172/355] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:33:44.243407 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-cc6b53bc-f979-48c1-8eeb-33eec4e8a266 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:44.245079 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-cc6b53bc-f979-48c1-8eeb-33eec4e8a266 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:44.264367 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cc6b53bc-f979-48c1-8eeb-33eec4e8a266 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:44.266274 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cc6b53bc-f979-48c1-8eeb-33eec4e8a266 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:44.267156 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cc6b53bc-f979-48c1-8eeb-33eec4e8a266 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:44.268119 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cc6b53bc-f979-48c1-8eeb-33eec4e8a266 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:44.424766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ae5f3769-5639-4946-9bc9-c6a01385a199 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:44.426248 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ae5f3769-5639-4946-9bc9-c6a01385a199 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:44.435841 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ae5f3769-5639-4946-9bc9-c6a01385a199 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:44.436277 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ae5f3769-5639-4946-9bc9-c6a01385a199 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:44.437056 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ae5f3769-5639-4946-9bc9-c6a01385a199 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:44.437542 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ae5f3769-5639-4946-9bc9-c6a01385a199 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:44.554847 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-cc6b53bc-f979-48c1-8eeb-33eec4e8a266 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:44.568077 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-cc6b53bc-f979-48c1-8eeb-33eec4e8a266 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1725 microversion: 2.1 time: 0.337790 May 19 06:33:44.568915 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 184/356] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:44 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1725 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:44.781404 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ae5f3769-5639-4946-9bc9-c6a01385a199 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:44.799833 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ae5f3769-5639-4946-9bc9-c6a01385a199 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1514 microversion: 2.1 time: 0.376317 May 19 06:33:44.821943 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 173/357] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:44 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1514 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:45.587891 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-699ca782-af0e-4e32-a889-77cfdb14794b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:45.588568 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-699ca782-af0e-4e32-a889-77cfdb14794b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:45.601821 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-699ca782-af0e-4e32-a889-77cfdb14794b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:45.603874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-699ca782-af0e-4e32-a889-77cfdb14794b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:45.605823 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-699ca782-af0e-4e32-a889-77cfdb14794b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:45.606973 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-699ca782-af0e-4e32-a889-77cfdb14794b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:45.966325 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-699ca782-af0e-4e32-a889-77cfdb14794b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:45.980306 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-699ca782-af0e-4e32-a889-77cfdb14794b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1725 microversion: 2.1 time: 0.396765 May 19 06:33:45.981507 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 185/358] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:45 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1725 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:47.012365 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7c4b9b4d-a056-4bcc-88f1-87e41b508ab0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:47.014817 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7c4b9b4d-a056-4bcc-88f1-87e41b508ab0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:47.035009 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7c4b9b4d-a056-4bcc-88f1-87e41b508ab0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:47.041637 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7c4b9b4d-a056-4bcc-88f1-87e41b508ab0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:47.043048 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7c4b9b4d-a056-4bcc-88f1-87e41b508ab0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:47.046134 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7c4b9b4d-a056-4bcc-88f1-87e41b508ab0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:47.373807 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7c4b9b4d-a056-4bcc-88f1-87e41b508ab0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:47.389306 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7c4b9b4d-a056-4bcc-88f1-87e41b508ab0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1725 microversion: 2.1 time: 0.390923 May 19 06:33:47.391209 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 174/359] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:46 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1725 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:48.419587 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d488b6ef-b850-4bbd-a194-c96b3870e1f9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:48.420886 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d488b6ef-b850-4bbd-a194-c96b3870e1f9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:48.429104 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d488b6ef-b850-4bbd-a194-c96b3870e1f9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:48.429852 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d488b6ef-b850-4bbd-a194-c96b3870e1f9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:48.430872 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d488b6ef-b850-4bbd-a194-c96b3870e1f9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:48.431463 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d488b6ef-b850-4bbd-a194-c96b3870e1f9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:48.596916 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d488b6ef-b850-4bbd-a194-c96b3870e1f9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:48.607986 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d488b6ef-b850-4bbd-a194-c96b3870e1f9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1725 microversion: 2.1 time: 0.192193 May 19 06:33:48.609357 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 186/360] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:48 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:48.702792 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9402c36b-e260-4e30-a174-0c73fb7b30e3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Action: 'create', calling method: .version_select at 0x7f9aeaf65c10>, body: {"keypair": {"name": "tempest-keypair-101075626", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyjg6F8awf2xK47nBXNUY/+AJ0fA2rc0TdA0Itsei9/+P7QLy+/sEOwA8Ulan+YeTyUipURwRq52ZgsMsyxsbvSW92jszvihsJvmxmXncYvn2GPRLWu9jysQ/IAC86INw=="}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:33:48.720557 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-9402c36b-e260-4e30-a174-0c73fb7b30e3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Getting quotas for project 35cb15f2075c41889b91291b645170a5. Resources: {'key_pairs'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:33:48.742000 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-9402c36b-e260-4e30-a174-0c73fb7b30e3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Getting quotas for user 6a71c3c016564c3b9ab0b6b58d378fda and project 35cb15f2075c41889b91291b645170a5. Resources: {'key_pairs'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:33:48.811541 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9402c36b-e260-4e30-a174-0c73fb7b30e3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.112803 May 19 06:33:48.812647 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 175/361] 10.222.0.65 () {60 vars in 1158 bytes} [Thu May 19 06:33:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:33:49.627398 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e2840d77-30bd-40f6-b43b-3f67aeafd7b0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:49.628856 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e2840d77-30bd-40f6-b43b-3f67aeafd7b0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:49.656513 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e2840d77-30bd-40f6-b43b-3f67aeafd7b0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:49.658455 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e2840d77-30bd-40f6-b43b-3f67aeafd7b0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:49.659813 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e2840d77-30bd-40f6-b43b-3f67aeafd7b0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:49.663592 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e2840d77-30bd-40f6-b43b-3f67aeafd7b0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:50.155449 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e2840d77-30bd-40f6-b43b-3f67aeafd7b0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:50.173445 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e2840d77-30bd-40f6-b43b-3f67aeafd7b0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1725 microversion: 2.1 time: 0.547970 May 19 06:33:50.174502 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 187/362] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:49 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1725 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:51.199503 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6c2dd899-4cd2-4aec-86c3-5df3d1f72eb7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:51.202697 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-6c2dd899-4cd2-4aec-86c3-5df3d1f72eb7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:51.219187 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6c2dd899-4cd2-4aec-86c3-5df3d1f72eb7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:51.220669 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6c2dd899-4cd2-4aec-86c3-5df3d1f72eb7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:51.223387 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6c2dd899-4cd2-4aec-86c3-5df3d1f72eb7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:51.224549 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6c2dd899-4cd2-4aec-86c3-5df3d1f72eb7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:52.186110 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6c2dd899-4cd2-4aec-86c3-5df3d1f72eb7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:52.196504 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6c2dd899-4cd2-4aec-86c3-5df3d1f72eb7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1725 microversion: 2.1 time: 1.003973 May 19 06:33:52.203461 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 176/363] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:51 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1725 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:52.533495 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a9c04edd-76a6-43e3-afc4-e2243fe85ee7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-15431482", "imageRef": "27959167-098e-44c5-ba0a-e9fb8054c377", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "860daf04-4a0a-4379-9eea-a84339c17edf"}], "security_groups": [{"name": "tempest-securitygroup--1736021003"}], "key_name": "tempest-keypair-101075626", "user_data": "}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:33:53.228510 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0f98f4fc-2df0-468a-8842-f4f58393a3ab tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:53.230133 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0f98f4fc-2df0-468a-8842-f4f58393a3ab tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:53.242634 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0f98f4fc-2df0-468a-8842-f4f58393a3ab tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:53.243687 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0f98f4fc-2df0-468a-8842-f4f58393a3ab tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:53.244834 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0f98f4fc-2df0-468a-8842-f4f58393a3ab tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:53.245387 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0f98f4fc-2df0-468a-8842-f4f58393a3ab tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:53.538607 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0f98f4fc-2df0-468a-8842-f4f58393a3ab tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:53.547883 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0f98f4fc-2df0-468a-8842-f4f58393a3ab tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1725 microversion: 2.1 time: 0.324196 May 19 06:33:53.562118 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 177/364] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:53 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1725 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:54.579743 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-5d8815c3-635e-4ccb-99a5-ba050545600a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:54.581225 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-5d8815c3-635e-4ccb-99a5-ba050545600a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:54.593273 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5d8815c3-635e-4ccb-99a5-ba050545600a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:54.594076 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5d8815c3-635e-4ccb-99a5-ba050545600a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:54.595657 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5d8815c3-635e-4ccb-99a5-ba050545600a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:54.598792 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5d8815c3-635e-4ccb-99a5-ba050545600a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:54.859913 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-5d8815c3-635e-4ccb-99a5-ba050545600a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:54.894775 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-5d8815c3-635e-4ccb-99a5-ba050545600a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1725 microversion: 2.1 time: 0.318784 May 19 06:33:54.896168 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 178/365] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:54 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1725 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:55.913591 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-679ffe2e-8533-4def-86bc-28b0f3e536ac tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:55.914329 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-679ffe2e-8533-4def-86bc-28b0f3e536ac tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:55.932969 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-679ffe2e-8533-4def-86bc-28b0f3e536ac tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:55.933427 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-679ffe2e-8533-4def-86bc-28b0f3e536ac tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:55.934193 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-679ffe2e-8533-4def-86bc-28b0f3e536ac tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:55.934627 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-679ffe2e-8533-4def-86bc-28b0f3e536ac tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:56.157400 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-679ffe2e-8533-4def-86bc-28b0f3e536ac tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:56.182775 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-679ffe2e-8533-4def-86bc-28b0f3e536ac tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1725 microversion: 2.1 time: 0.273256 May 19 06:33:56.183417 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 179/366] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:55 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1725 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:33:57.201061 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-75084e70-626c-4318-9980-77feedce3f3e tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:57.202866 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-75084e70-626c-4318-9980-77feedce3f3e tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:57.233213 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-75084e70-626c-4318-9980-77feedce3f3e tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:57.233696 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-75084e70-626c-4318-9980-77feedce3f3e tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:57.234486 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-75084e70-626c-4318-9980-77feedce3f3e tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:57.235167 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-75084e70-626c-4318-9980-77feedce3f3e tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:57.479001 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-75084e70-626c-4318-9980-77feedce3f3e tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:57.491352 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-75084e70-626c-4318-9980-77feedce3f3e tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1725 microversion: 2.1 time: 0.294887 May 19 06:33:57.504115 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 180/367] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:57 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1725 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:33:58.509565 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-993c49b5-5744-4141-892a-3fa825dc9d43 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:33:58.510491 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-993c49b5-5744-4141-892a-3fa825dc9d43 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:33:58.525061 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-993c49b5-5744-4141-892a-3fa825dc9d43 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:58.525582 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-993c49b5-5744-4141-892a-3fa825dc9d43 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:58.526374 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-993c49b5-5744-4141-892a-3fa825dc9d43 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:33:58.526754 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-993c49b5-5744-4141-892a-3fa825dc9d43 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:33:58.731614 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-993c49b5-5744-4141-892a-3fa825dc9d43 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:33:58.741902 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-993c49b5-5744-4141-892a-3fa825dc9d43 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1725 microversion: 2.1 time: 0.236090 May 19 06:33:58.744759 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 181/368] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:33:58 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1725 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:33:59.225017 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f1eb8237-33b5-4217-bb09-e1490fc35129 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Action: 'create', calling method: .version_select at 0x7f9aeaee9430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1820090257", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwVuyRUsqvN6xY0WBCYXC9PmfYXBhCBlk4CQl64MkTQ0yFjg9nDqJo57V7tVYGNfJrt6d3+M6+vcYGkiArivCAxSV1GlJ2iKI14JNrqMZuHZwzn6JUmXEcHrW7FWmIaGA=="}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:33:59.237947 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=4 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:33:59.259488 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-f1eb8237-33b5-4217-bb09-e1490fc35129 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Getting quotas for project 14bd96bd91c44b888074b760e9834814. Resources: {'key_pairs'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:33:59.268428 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-f1eb8237-33b5-4217-bb09-e1490fc35129 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Getting quotas for user d4008c6bb57b4a91b2761fc87a1e9d2f and project 14bd96bd91c44b888074b760e9834814. Resources: {'key_pairs'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:33:59.318236 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f1eb8237-33b5-4217-bb09-e1490fc35129 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.099935 May 19 06:33:59.320039 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 182/369] 10.222.0.65 () {60 vars in 1158 bytes} [Thu May 19 06:33:59 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:33:59.395816 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.network.neutron [None req-a9c04edd-76a6-43e3-afc4-e2243fe85ee7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] validate_networks() for [('860daf04-4a0a-4379-9eea-a84339c17edf', None, None, None, None, None)] {{(pid=117711) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 06:33:59.465018 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-55363163-12ce-4379-b34e-bc6b2091aa48 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-971318002", "imageRef": "82e31978-034a-46c4-9241-c809ace4fd9c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1820090257", "networks": [{"uuid": "b9ac4da1-272d-4997-a2c4-1ea590fe3959"}]}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:33:59.526146 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.network.neutron [None req-55363163-12ce-4379-b34e-bc6b2091aa48 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] validate_networks() for [('b9ac4da1-272d-4997-a2c4-1ea590fe3959', None, None, None, None, None)] {{(pid=117712) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 06:34:00.000635 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-a9c04edd-76a6-43e3-afc4-e2243fe85ee7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Flavor limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 06:34:00.002105 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-a9c04edd-76a6-43e3-afc4-e2243fe85ee7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Image limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 06:34:00.002769 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-a9c04edd-76a6-43e3-afc4-e2243fe85ee7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Flavor pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 06:34:00.003345 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-a9c04edd-76a6-43e3-afc4-e2243fe85ee7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Image pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 06:34:00.004055 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-a9c04edd-76a6-43e3-afc4-e2243fe85ee7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 06:34:00.004206 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-55363163-12ce-4379-b34e-bc6b2091aa48 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Flavor limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 06:34:00.004831 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-55363163-12ce-4379-b34e-bc6b2091aa48 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Image limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 06:34:00.005422 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-55363163-12ce-4379-b34e-bc6b2091aa48 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Flavor pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 06:34:00.005912 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-55363163-12ce-4379-b34e-bc6b2091aa48 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Image pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 06:34:00.006392 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-55363163-12ce-4379-b34e-bc6b2091aa48 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 06:34:00.015187 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a9c04edd-76a6-43e3-afc4-e2243fe85ee7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:00.015642 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a9c04edd-76a6-43e3-afc4-e2243fe85ee7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:00.017173 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a9c04edd-76a6-43e3-afc4-e2243fe85ee7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:00.017798 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a9c04edd-76a6-43e3-afc4-e2243fe85ee7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:00.018732 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-55363163-12ce-4379-b34e-bc6b2091aa48 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:00.019282 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-55363163-12ce-4379-b34e-bc6b2091aa48 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:00.020493 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-55363163-12ce-4379-b34e-bc6b2091aa48 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:00.021091 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-55363163-12ce-4379-b34e-bc6b2091aa48 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:00.038429 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-a9c04edd-76a6-43e3-afc4-e2243fe85ee7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Getting quotas for project 35cb15f2075c41889b91291b645170a5. Resources: {'ram', 'cores', 'instances'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:34:00.042416 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-55363163-12ce-4379-b34e-bc6b2091aa48 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Getting quotas for project 14bd96bd91c44b888074b760e9834814. Resources: {'ram', 'cores', 'instances'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:34:00.043405 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-a9c04edd-76a6-43e3-afc4-e2243fe85ee7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Getting quotas for user 6a71c3c016564c3b9ab0b6b58d378fda and project 35cb15f2075c41889b91291b645170a5. Resources: {'ram', 'cores', 'instances'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:34:00.047059 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-55363163-12ce-4379-b34e-bc6b2091aa48 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Getting quotas for user d4008c6bb57b4a91b2761fc87a1e9d2f and project 14bd96bd91c44b888074b760e9834814. Resources: {'ram', 'cores', 'instances'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:34:00.058423 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a9c04edd-76a6-43e3-afc4-e2243fe85ee7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Going to run 1 instances... {{(pid=117711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 06:34:00.061097 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a9c04edd-76a6-43e3-afc4-e2243fe85ee7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27959167-098e-44c5-ba0a-e9fb8054c377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 06:34:00.065766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-55363163-12ce-4379-b34e-bc6b2091aa48 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Going to run 1 instances... {{(pid=117712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 06:34:00.068283 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-55363163-12ce-4379-b34e-bc6b2091aa48 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82e31978-034a-46c4-9241-c809ace4fd9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 06:34:00.114412 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a9c04edd-76a6-43e3-afc4-e2243fe85ee7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 7.598704 May 19 06:34:00.115247 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 188/370] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 06:33:52 2022] POST /compute/v2.1/servers => generated 409 bytes in 7600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 06:34:00.120350 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-01fa27e4-61b7-4420-9acf-6cd9d4aa196a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:00.121236 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-01fa27e4-61b7-4420-9acf-6cd9d4aa196a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:00.131250 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-01fa27e4-61b7-4420-9acf-6cd9d4aa196a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:00.132081 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-01fa27e4-61b7-4420-9acf-6cd9d4aa196a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:00.133090 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-01fa27e4-61b7-4420-9acf-6cd9d4aa196a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:00.133929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-01fa27e4-61b7-4420-9acf-6cd9d4aa196a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:00.150472 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-55363163-12ce-4379-b34e-bc6b2091aa48 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.688929 May 19 06:34:00.153869 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 183/371] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 06:33:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 06:34:00.164246 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6a7afd93-8041-4221-b39e-746f3534ec69 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:00.165655 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-6a7afd93-8041-4221-b39e-746f3534ec69 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:00.254308 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6a7afd93-8041-4221-b39e-746f3534ec69 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:00.265265 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6a7afd93-8041-4221-b39e-746f3534ec69 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1243 microversion: 2.1 time: 0.107917 May 19 06:34:00.266011 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 184/372] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:00 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1243 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:00.281825 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b7d112f3-b0b9-4b72-813d-40b1ba6330c1 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:00.282943 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b7d112f3-b0b9-4b72-813d-40b1ba6330c1 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:00.338973 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-01fa27e4-61b7-4420-9acf-6cd9d4aa196a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:00.348818 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-01fa27e4-61b7-4420-9acf-6cd9d4aa196a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1702 microversion: 2.1 time: 0.232141 May 19 06:34:00.349930 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 189/373] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:00 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1702 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:00.374994 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-9bb75bdb-27f7-4092-ab95-132d5d2c8172 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:34:00.379129 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b7d112f3-b0b9-4b72-813d-40b1ba6330c1 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:00.385418 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9bb75bdb-27f7-4092-ab95-132d5d2c8172 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:00.386105 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9bb75bdb-27f7-4092-ab95-132d5d2c8172 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:00.392585 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b7d112f3-b0b9-4b72-813d-40b1ba6330c1 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1258 microversion: 2.1 time: 0.114831 May 19 06:34:00.393149 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 185/374] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:00 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1258 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:00.474774 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-9bb75bdb-27f7-4092-ab95-132d5d2c8172 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Going to try to start instance {{(pid=117711) start /opt/stack/nova/nova/compute/api.py:2730}} May 19 06:34:00.480112 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:34:00.558237 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-9bb75bdb-27f7-4092-ab95-132d5d2c8172 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "POST /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac/action" status: 202 len: 0 microversion: 2.1 time: 0.188480 May 19 06:34:00.559187 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 190/375] 10.222.0.65 () {60 vars in 1277 bytes} [Thu May 19 06:34:00 2022] POST /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 06:34:00.587288 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-08ac6f4f-c0cd-420b-83e5-fa7c6d079ae7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:00.591006 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-08ac6f4f-c0cd-420b-83e5-fa7c6d079ae7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:00.612060 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-08ac6f4f-c0cd-420b-83e5-fa7c6d079ae7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:00.612784 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-08ac6f4f-c0cd-420b-83e5-fa7c6d079ae7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:00.613778 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-08ac6f4f-c0cd-420b-83e5-fa7c6d079ae7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:00.614417 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-08ac6f4f-c0cd-420b-83e5-fa7c6d079ae7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:00.934588 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-08ac6f4f-c0cd-420b-83e5-fa7c6d079ae7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:00.951710 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-08ac6f4f-c0cd-420b-83e5-fa7c6d079ae7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1711 microversion: 2.1 time: 0.373460 May 19 06:34:00.966715 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 186/376] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:00 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1711 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:01.284774 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-04a94b28-3b58-4965-84b1-c64a910d37de tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:01.285735 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-04a94b28-3b58-4965-84b1-c64a910d37de tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:01.319401 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-04a94b28-3b58-4965-84b1-c64a910d37de tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:01.319982 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-04a94b28-3b58-4965-84b1-c64a910d37de tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:01.325881 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-04a94b28-3b58-4965-84b1-c64a910d37de tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:01.326608 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-04a94b28-3b58-4965-84b1-c64a910d37de tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:01.416194 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d67595b0-a47d-4644-a7c7-e47ac5de8a67 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:01.417102 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d67595b0-a47d-4644-a7c7-e47ac5de8a67 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:01.430617 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-04a94b28-3b58-4965-84b1-c64a910d37de tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:01.434505 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d67595b0-a47d-4644-a7c7-e47ac5de8a67 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:01.437845 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d67595b0-a47d-4644-a7c7-e47ac5de8a67 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:01.439339 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d67595b0-a47d-4644-a7c7-e47ac5de8a67 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:01.442404 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d67595b0-a47d-4644-a7c7-e47ac5de8a67 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:01.442719 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-04a94b28-3b58-4965-84b1-c64a910d37de tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1295 microversion: 2.1 time: 0.163684 May 19 06:34:01.455666 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 191/377] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:01 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1295 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:01.524411 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d67595b0-a47d-4644-a7c7-e47ac5de8a67 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:01.540603 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d67595b0-a47d-4644-a7c7-e47ac5de8a67 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1310 microversion: 2.1 time: 0.129781 May 19 06:34:01.542334 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 187/378] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:01 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1310 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:01.971074 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e9ef636b-ed5f-4030-b076-0b94fab1b05c tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:01.972288 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e9ef636b-ed5f-4030-b076-0b94fab1b05c tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:01.984465 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e9ef636b-ed5f-4030-b076-0b94fab1b05c tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:01.985239 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e9ef636b-ed5f-4030-b076-0b94fab1b05c tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:01.986719 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e9ef636b-ed5f-4030-b076-0b94fab1b05c tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:01.992907 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e9ef636b-ed5f-4030-b076-0b94fab1b05c tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:02.384429 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e9ef636b-ed5f-4030-b076-0b94fab1b05c tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:02.398239 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e9ef636b-ed5f-4030-b076-0b94fab1b05c tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1711 microversion: 2.1 time: 0.431000 May 19 06:34:02.398818 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 192/379] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:01 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1711 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:02.460630 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c15e8fd0-e566-4105-bdc4-466a65926bb4 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:02.461982 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c15e8fd0-e566-4105-bdc4-466a65926bb4 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:02.469976 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c15e8fd0-e566-4105-bdc4-466a65926bb4 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:02.470731 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c15e8fd0-e566-4105-bdc4-466a65926bb4 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:02.471766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c15e8fd0-e566-4105-bdc4-466a65926bb4 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:02.472455 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c15e8fd0-e566-4105-bdc4-466a65926bb4 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:02.561534 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-29411578-29ea-45d1-b18a-ec9d7ee89136 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:02.562146 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-29411578-29ea-45d1-b18a-ec9d7ee89136 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:02.577970 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-29411578-29ea-45d1-b18a-ec9d7ee89136 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:02.578622 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-29411578-29ea-45d1-b18a-ec9d7ee89136 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:02.580121 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-29411578-29ea-45d1-b18a-ec9d7ee89136 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:02.580706 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-29411578-29ea-45d1-b18a-ec9d7ee89136 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:02.580863 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c15e8fd0-e566-4105-bdc4-466a65926bb4 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:02.600945 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c15e8fd0-e566-4105-bdc4-466a65926bb4 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1301 microversion: 2.1 time: 0.144118 May 19 06:34:02.602279 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 188/380] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:02 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1301 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:02.679530 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-29411578-29ea-45d1-b18a-ec9d7ee89136 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:02.693054 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-29411578-29ea-45d1-b18a-ec9d7ee89136 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1316 microversion: 2.1 time: 0.134884 May 19 06:34:02.705189 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 193/381] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:02 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1316 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:34:03.424385 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-27d43c8a-b4b9-4dee-b512-dd7875feb7a8 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:03.425018 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-27d43c8a-b4b9-4dee-b512-dd7875feb7a8 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:03.462260 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-27d43c8a-b4b9-4dee-b512-dd7875feb7a8 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:03.467642 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-27d43c8a-b4b9-4dee-b512-dd7875feb7a8 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:03.475490 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-27d43c8a-b4b9-4dee-b512-dd7875feb7a8 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:03.478570 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-27d43c8a-b4b9-4dee-b512-dd7875feb7a8 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:03.514422 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=100 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:34:03.620254 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-dd6682d5-8c89-4a16-8962-e3796d000fa7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:03.620934 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-dd6682d5-8c89-4a16-8962-e3796d000fa7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:03.665860 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:34:03.675908 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dd6682d5-8c89-4a16-8962-e3796d000fa7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:03.678813 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dd6682d5-8c89-4a16-8962-e3796d000fa7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:03.680799 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dd6682d5-8c89-4a16-8962-e3796d000fa7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:03.685149 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dd6682d5-8c89-4a16-8962-e3796d000fa7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:03.905503 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-27d43c8a-b4b9-4dee-b512-dd7875feb7a8 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:03.927716 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-27d43c8a-b4b9-4dee-b512-dd7875feb7a8 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1715 microversion: 2.1 time: 0.512066 May 19 06:34:03.937690 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 189/382] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:03 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1715 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:03.952069 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-eb30ede8-4f05-4014-a56a-3c39bce8f76d tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:03.958460 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-eb30ede8-4f05-4014-a56a-3c39bce8f76d tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:03.979857 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-eb30ede8-4f05-4014-a56a-3c39bce8f76d tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:03.998464 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-eb30ede8-4f05-4014-a56a-3c39bce8f76d tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:03.999754 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-eb30ede8-4f05-4014-a56a-3c39bce8f76d tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:04.001834 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-eb30ede8-4f05-4014-a56a-3c39bce8f76d tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:04.263005 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-eb30ede8-4f05-4014-a56a-3c39bce8f76d tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:04.274960 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-eb30ede8-4f05-4014-a56a-3c39bce8f76d tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1358 microversion: 2.1 time: 0.326646 May 19 06:34:04.287645 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 190/383] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:03 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1358 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:04.783070 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-dd6682d5-8c89-4a16-8962-e3796d000fa7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:04.806777 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-dd6682d5-8c89-4a16-8962-e3796d000fa7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1369 microversion: 2.1 time: 1.191498 May 19 06:34:04.818084 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 194/384] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:03 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1369 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:05.295550 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-87f1d624-b7e9-4c90-a9b7-ade7238e9447 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:05.296116 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-87f1d624-b7e9-4c90-a9b7-ade7238e9447 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:05.308842 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-87f1d624-b7e9-4c90-a9b7-ade7238e9447 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:05.309449 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-87f1d624-b7e9-4c90-a9b7-ade7238e9447 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:05.310331 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-87f1d624-b7e9-4c90-a9b7-ade7238e9447 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:05.314287 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-87f1d624-b7e9-4c90-a9b7-ade7238e9447 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:05.588412 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-87f1d624-b7e9-4c90-a9b7-ade7238e9447 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:05.602928 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-87f1d624-b7e9-4c90-a9b7-ade7238e9447 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1358 microversion: 2.1 time: 0.311193 May 19 06:34:05.603616 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 191/385] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:05 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1358 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:05.823894 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8822c427-88cf-40b7-937b-beca895a3a5d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:05.825179 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8822c427-88cf-40b7-937b-beca895a3a5d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:05.839035 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8822c427-88cf-40b7-937b-beca895a3a5d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:05.848338 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8822c427-88cf-40b7-937b-beca895a3a5d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:05.849190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8822c427-88cf-40b7-937b-beca895a3a5d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:05.849663 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8822c427-88cf-40b7-937b-beca895a3a5d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:06.221994 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-8822c427-88cf-40b7-937b-beca895a3a5d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:06.237097 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8822c427-88cf-40b7-937b-beca895a3a5d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1369 microversion: 2.1 time: 0.416931 May 19 06:34:06.249359 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 195/386] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:05 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1369 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:06.638334 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-5d2ee66a-e384-418f-9139-6f573b460cab tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:06.639628 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-b68eb8ab-cf95-4639-a4fa-79ab044b0a4f req-07b71e01-0b8a-4299-a7a5-f50c014408ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e905065-4c72-403f-ba1f-3d56ec56b4f0", "tag": "e9987cd3-ff74-46e7-8754-720b4458b23e"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:34:06.640299 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-5d2ee66a-e384-418f-9139-6f573b460cab tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:06.660582 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5d2ee66a-e384-418f-9139-6f573b460cab tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:06.662219 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5d2ee66a-e384-418f-9139-6f573b460cab tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:06.664362 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-b68eb8ab-cf95-4639-a4fa-79ab044b0a4f req-07b71e01-0b8a-4299-a7a5-f50c014408ce service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:06.666120 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5d2ee66a-e384-418f-9139-6f573b460cab tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:06.666752 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5d2ee66a-e384-418f-9139-6f573b460cab tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:06.667467 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-b68eb8ab-cf95-4639-a4fa-79ab044b0a4f req-07b71e01-0b8a-4299-a7a5-f50c014408ce service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:06.709954 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-b68eb8ab-cf95-4639-a4fa-79ab044b0a4f req-07b71e01-0b8a-4299-a7a5-f50c014408ce service nova] Creating event network-changed:e9987cd3-ff74-46e7-8754-720b4458b23e for instance 3e905065-4c72-403f-ba1f-3d56ec56b4f0 on hv-cinder-83699 May 19 06:34:06.727831 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-b68eb8ab-cf95-4639-a4fa-79ab044b0a4f req-07b71e01-0b8a-4299-a7a5-f50c014408ce service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098465 May 19 06:34:06.728493 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 196/387] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:34:07.041845 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-5d2ee66a-e384-418f-9139-6f573b460cab tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:07.062005 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-5d2ee66a-e384-418f-9139-6f573b460cab tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1358 microversion: 2.1 time: 0.439728 May 19 06:34:07.088727 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 192/388] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:06 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1358 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:07.259904 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5d7588b0-0667-44ca-8d99-03758d93a8fb tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:07.261363 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5d7588b0-0667-44ca-8d99-03758d93a8fb tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:07.280174 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5d7588b0-0667-44ca-8d99-03758d93a8fb tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:07.282452 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5d7588b0-0667-44ca-8d99-03758d93a8fb tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:07.283637 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5d7588b0-0667-44ca-8d99-03758d93a8fb tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:07.284421 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5d7588b0-0667-44ca-8d99-03758d93a8fb tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:07.732365 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5d7588b0-0667-44ca-8d99-03758d93a8fb tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:07.740653 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5d7588b0-0667-44ca-8d99-03758d93a8fb tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1369 microversion: 2.1 time: 0.486771 May 19 06:34:07.743298 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 197/389] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:07 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1369 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:08.080766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-069ca860-515e-4f5d-9ed9-d82bc8cf45ef tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:08.082076 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-069ca860-515e-4f5d-9ed9-d82bc8cf45ef tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:08.090337 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-069ca860-515e-4f5d-9ed9-d82bc8cf45ef tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:08.091058 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-069ca860-515e-4f5d-9ed9-d82bc8cf45ef tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:08.091976 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-069ca860-515e-4f5d-9ed9-d82bc8cf45ef tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:08.092541 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-069ca860-515e-4f5d-9ed9-d82bc8cf45ef tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:08.296820 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-069ca860-515e-4f5d-9ed9-d82bc8cf45ef tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:08.307693 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-069ca860-515e-4f5d-9ed9-d82bc8cf45ef tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1358 microversion: 2.1 time: 0.231076 May 19 06:34:08.309935 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 193/390] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:08 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:08.759388 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-4cf73726-9c99-41bc-b3e5-4c25c7646066 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:08.760806 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-4cf73726-9c99-41bc-b3e5-4c25c7646066 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:08.771759 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4cf73726-9c99-41bc-b3e5-4c25c7646066 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:08.772684 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4cf73726-9c99-41bc-b3e5-4c25c7646066 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:08.773775 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4cf73726-9c99-41bc-b3e5-4c25c7646066 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:08.774787 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4cf73726-9c99-41bc-b3e5-4c25c7646066 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:08.783119 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-c0a39fb4-fc17-41e9-bb44-4e8f43dc597b req-13ef65b9-e5c0-4f76-98a7-e08432ad5aad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "285cd5e6-76c3-491a-8b1d-23837478002a", "tag": "aaf80320-db37-4f95-9ea4-8a1de850bf84"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:34:08.794809 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-c0a39fb4-fc17-41e9-bb44-4e8f43dc597b req-13ef65b9-e5c0-4f76-98a7-e08432ad5aad service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:08.795549 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-c0a39fb4-fc17-41e9-bb44-4e8f43dc597b req-13ef65b9-e5c0-4f76-98a7-e08432ad5aad service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:08.809092 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-c0a39fb4-fc17-41e9-bb44-4e8f43dc597b req-13ef65b9-e5c0-4f76-98a7-e08432ad5aad service nova] Creating event network-changed:aaf80320-db37-4f95-9ea4-8a1de850bf84 for instance 285cd5e6-76c3-491a-8b1d-23837478002a on hv-cinder-83699 May 19 06:34:08.819456 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-c0a39fb4-fc17-41e9-bb44-4e8f43dc597b req-13ef65b9-e5c0-4f76-98a7-e08432ad5aad service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041055 May 19 06:34:08.821696 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 194/391] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:34:08.956114 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4cf73726-9c99-41bc-b3e5-4c25c7646066 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:08.964872 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-4cf73726-9c99-41bc-b3e5-4c25c7646066 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1369 microversion: 2.1 time: 0.209323 May 19 06:34:08.965450 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 198/392] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:08 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1369 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:09.327362 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-eddf883a-f311-4827-b246-74f335eee290 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:09.330532 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-eddf883a-f311-4827-b246-74f335eee290 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:09.338968 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-eddf883a-f311-4827-b246-74f335eee290 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:09.339421 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-eddf883a-f311-4827-b246-74f335eee290 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:09.340435 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-eddf883a-f311-4827-b246-74f335eee290 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:09.340899 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-eddf883a-f311-4827-b246-74f335eee290 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:09.503493 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-eddf883a-f311-4827-b246-74f335eee290 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:09.513865 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-eddf883a-f311-4827-b246-74f335eee290 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1358 microversion: 2.1 time: 0.190629 May 19 06:34:09.525394 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 195/393] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:09 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:09.986668 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7ea7e3d1-caca-484b-8ca4-94924a77d511 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:09.988017 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7ea7e3d1-caca-484b-8ca4-94924a77d511 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:09.996089 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7ea7e3d1-caca-484b-8ca4-94924a77d511 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:09.996712 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7ea7e3d1-caca-484b-8ca4-94924a77d511 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:09.997733 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7ea7e3d1-caca-484b-8ca4-94924a77d511 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:09.998442 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7ea7e3d1-caca-484b-8ca4-94924a77d511 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:10.027042 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:34:10.054400 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=6 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:34:10.206844 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7ea7e3d1-caca-484b-8ca4-94924a77d511 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:10.214483 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7ea7e3d1-caca-484b-8ca4-94924a77d511 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1369 microversion: 2.1 time: 0.234797 May 19 06:34:10.215198 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 199/394] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:09 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1369 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:10.534525 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e81f8437-bb60-4fa7-a02d-059c3465e091 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:10.535307 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e81f8437-bb60-4fa7-a02d-059c3465e091 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:10.537256 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:34:10.538500 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=14 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:34:10.545248 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e81f8437-bb60-4fa7-a02d-059c3465e091 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:10.545778 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e81f8437-bb60-4fa7-a02d-059c3465e091 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:10.546474 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e81f8437-bb60-4fa7-a02d-059c3465e091 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:10.546903 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e81f8437-bb60-4fa7-a02d-059c3465e091 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:10.701425 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e81f8437-bb60-4fa7-a02d-059c3465e091 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:10.712227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e81f8437-bb60-4fa7-a02d-059c3465e091 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1358 microversion: 2.1 time: 0.181570 May 19 06:34:10.713900 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 196/395] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:10 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:11.235525 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-75525cc5-890f-40e7-852d-64a2e86e5c69 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:11.236933 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-75525cc5-890f-40e7-852d-64a2e86e5c69 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:11.246970 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-75525cc5-890f-40e7-852d-64a2e86e5c69 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:11.247750 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-75525cc5-890f-40e7-852d-64a2e86e5c69 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:11.248796 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-75525cc5-890f-40e7-852d-64a2e86e5c69 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:11.249487 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-75525cc5-890f-40e7-852d-64a2e86e5c69 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:11.445398 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-75525cc5-890f-40e7-852d-64a2e86e5c69 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:11.459082 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-75525cc5-890f-40e7-852d-64a2e86e5c69 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1369 microversion: 2.1 time: 0.229677 May 19 06:34:11.460018 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 200/396] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:11 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1369 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:11.732446 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d56448aa-8d62-4d9c-b09c-ef4077a89b93 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:11.733164 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d56448aa-8d62-4d9c-b09c-ef4077a89b93 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:11.739716 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:34:11.741640 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d56448aa-8d62-4d9c-b09c-ef4077a89b93 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:11.742084 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d56448aa-8d62-4d9c-b09c-ef4077a89b93 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:11.742877 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d56448aa-8d62-4d9c-b09c-ef4077a89b93 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:11.743310 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d56448aa-8d62-4d9c-b09c-ef4077a89b93 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:11.893568 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d56448aa-8d62-4d9c-b09c-ef4077a89b93 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:11.901934 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d56448aa-8d62-4d9c-b09c-ef4077a89b93 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1358 microversion: 2.1 time: 0.173642 May 19 06:34:11.902517 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 197/397] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:11 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:12.476337 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8fdd2d25-e6db-455c-a56f-45f750323f74 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:12.476931 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8fdd2d25-e6db-455c-a56f-45f750323f74 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:12.483609 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8fdd2d25-e6db-455c-a56f-45f750323f74 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:12.484053 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8fdd2d25-e6db-455c-a56f-45f750323f74 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:12.484922 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8fdd2d25-e6db-455c-a56f-45f750323f74 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:12.485613 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8fdd2d25-e6db-455c-a56f-45f750323f74 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:12.655394 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-8fdd2d25-e6db-455c-a56f-45f750323f74 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:12.664635 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8fdd2d25-e6db-455c-a56f-45f750323f74 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1369 microversion: 2.1 time: 0.191983 May 19 06:34:12.665226 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 201/398] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:12 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1369 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:12.920293 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3eaf2804-b838-4750-a58e-cd7529a0dd37 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:12.920920 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3eaf2804-b838-4750-a58e-cd7529a0dd37 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:12.929316 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3eaf2804-b838-4750-a58e-cd7529a0dd37 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:12.929789 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3eaf2804-b838-4750-a58e-cd7529a0dd37 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:12.930571 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3eaf2804-b838-4750-a58e-cd7529a0dd37 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:12.931010 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3eaf2804-b838-4750-a58e-cd7529a0dd37 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:13.100692 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3eaf2804-b838-4750-a58e-cd7529a0dd37 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:13.111839 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3eaf2804-b838-4750-a58e-cd7529a0dd37 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1358 microversion: 2.1 time: 0.195582 May 19 06:34:13.112711 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 198/399] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:12 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:13.136587 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-75f1040b-3a22-4a40-bb6e-fc9ef6bdf32f req-a3e3d9d8-e077-493f-b384-11e99b8b6830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e905065-4c72-403f-ba1f-3d56ec56b4f0", "name": "network-vif-plugged", "status": "completed", "tag": "e9987cd3-ff74-46e7-8754-720b4458b23e"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:34:13.152714 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-75f1040b-3a22-4a40-bb6e-fc9ef6bdf32f req-a3e3d9d8-e077-493f-b384-11e99b8b6830 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:13.153717 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-75f1040b-3a22-4a40-bb6e-fc9ef6bdf32f req-a3e3d9d8-e077-493f-b384-11e99b8b6830 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:13.166912 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-75f1040b-3a22-4a40-bb6e-fc9ef6bdf32f req-a3e3d9d8-e077-493f-b384-11e99b8b6830 service nova] Creating event network-vif-plugged:e9987cd3-ff74-46e7-8754-720b4458b23e for instance 3e905065-4c72-403f-ba1f-3d56ec56b4f0 on hv-cinder-83699 May 19 06:34:13.174993 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-75f1040b-3a22-4a40-bb6e-fc9ef6bdf32f req-a3e3d9d8-e077-493f-b384-11e99b8b6830 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039817 May 19 06:34:13.174993 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 202/400] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:34:13.681918 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d4215e91-ab0f-4520-b26f-af718add9e16 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:13.682580 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d4215e91-ab0f-4520-b26f-af718add9e16 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:13.690672 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d4215e91-ab0f-4520-b26f-af718add9e16 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:13.691420 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d4215e91-ab0f-4520-b26f-af718add9e16 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:13.692372 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d4215e91-ab0f-4520-b26f-af718add9e16 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:13.692969 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d4215e91-ab0f-4520-b26f-af718add9e16 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:13.859736 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d4215e91-ab0f-4520-b26f-af718add9e16 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:13.867654 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d4215e91-ab0f-4520-b26f-af718add9e16 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1369 microversion: 2.1 time: 0.189628 May 19 06:34:13.868305 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 199/401] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:13 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1369 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:14.146650 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b241fb56-2724-47a1-8811-1822fb7e49f9 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:14.147498 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b241fb56-2724-47a1-8811-1822fb7e49f9 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:14.154773 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b241fb56-2724-47a1-8811-1822fb7e49f9 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:14.155229 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b241fb56-2724-47a1-8811-1822fb7e49f9 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:14.156001 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b241fb56-2724-47a1-8811-1822fb7e49f9 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:14.156436 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b241fb56-2724-47a1-8811-1822fb7e49f9 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:14.308276 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b241fb56-2724-47a1-8811-1822fb7e49f9 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:14.317832 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b241fb56-2724-47a1-8811-1822fb7e49f9 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1358 microversion: 2.1 time: 0.177358 May 19 06:34:14.319225 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 203/402] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:14 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:14.886235 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-447c58d7-fa99-4f4a-8d87-80bbe60d07b1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:14.886955 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-447c58d7-fa99-4f4a-8d87-80bbe60d07b1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:14.894168 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-447c58d7-fa99-4f4a-8d87-80bbe60d07b1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:14.894617 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-447c58d7-fa99-4f4a-8d87-80bbe60d07b1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:14.895375 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-447c58d7-fa99-4f4a-8d87-80bbe60d07b1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:14.895916 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-447c58d7-fa99-4f4a-8d87-80bbe60d07b1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:15.039550 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-447c58d7-fa99-4f4a-8d87-80bbe60d07b1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:15.050785 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-447c58d7-fa99-4f4a-8d87-80bbe60d07b1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1369 microversion: 2.1 time: 0.169654 May 19 06:34:15.051409 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 200/403] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:14 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1369 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:15.338879 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d6930b75-2fea-4684-a288-db13915607d7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:15.339642 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d6930b75-2fea-4684-a288-db13915607d7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:15.350819 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d6930b75-2fea-4684-a288-db13915607d7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:15.351197 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d6930b75-2fea-4684-a288-db13915607d7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:15.352133 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d6930b75-2fea-4684-a288-db13915607d7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:15.352699 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d6930b75-2fea-4684-a288-db13915607d7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:15.723303 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d6930b75-2fea-4684-a288-db13915607d7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:15.732385 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d6930b75-2fea-4684-a288-db13915607d7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1358 microversion: 2.1 time: 0.399940 May 19 06:34:15.732969 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 204/404] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:15 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1358 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:16.067979 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-56728ec9-f97a-403e-b556-cef69e77ac1b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:16.068607 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-56728ec9-f97a-403e-b556-cef69e77ac1b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:16.075029 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-56728ec9-f97a-403e-b556-cef69e77ac1b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:16.075473 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-56728ec9-f97a-403e-b556-cef69e77ac1b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:16.076218 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-56728ec9-f97a-403e-b556-cef69e77ac1b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:16.076643 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-56728ec9-f97a-403e-b556-cef69e77ac1b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:16.211316 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-56728ec9-f97a-403e-b556-cef69e77ac1b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:16.220597 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-56728ec9-f97a-403e-b556-cef69e77ac1b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1369 microversion: 2.1 time: 0.156160 May 19 06:34:16.221187 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 201/405] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:16 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1369 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:34:16.752044 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-91f9d8b4-9fe2-4feb-8b83-704c8b40790c tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:16.752658 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-91f9d8b4-9fe2-4feb-8b83-704c8b40790c tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:16.760108 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-91f9d8b4-9fe2-4feb-8b83-704c8b40790c tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:16.760554 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-91f9d8b4-9fe2-4feb-8b83-704c8b40790c tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:16.761561 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-91f9d8b4-9fe2-4feb-8b83-704c8b40790c tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:16.762152 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-91f9d8b4-9fe2-4feb-8b83-704c8b40790c tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:17.142266 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-91f9d8b4-9fe2-4feb-8b83-704c8b40790c tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:17.152167 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-91f9d8b4-9fe2-4feb-8b83-704c8b40790c tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1358 microversion: 2.1 time: 0.404812 May 19 06:34:17.152753 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 205/406] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:16 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1358 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:17.239799 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-5e81abe7-a571-4043-b55a-8dec4a69e83b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:17.240512 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-5e81abe7-a571-4043-b55a-8dec4a69e83b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:17.246991 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5e81abe7-a571-4043-b55a-8dec4a69e83b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:17.247530 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5e81abe7-a571-4043-b55a-8dec4a69e83b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:17.248293 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5e81abe7-a571-4043-b55a-8dec4a69e83b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:17.248777 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5e81abe7-a571-4043-b55a-8dec4a69e83b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:17.481357 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-5e81abe7-a571-4043-b55a-8dec4a69e83b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:17.491168 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-5e81abe7-a571-4043-b55a-8dec4a69e83b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1369 microversion: 2.1 time: 0.253724 May 19 06:34:17.491168 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 202/407] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:17 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1369 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:18.169446 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-9059a9f9-07d5-4daf-8795-b106a06ff02e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:18.170230 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-9059a9f9-07d5-4daf-8795-b106a06ff02e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:18.176931 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9059a9f9-07d5-4daf-8795-b106a06ff02e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:18.177497 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9059a9f9-07d5-4daf-8795-b106a06ff02e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:18.178391 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9059a9f9-07d5-4daf-8795-b106a06ff02e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:18.178890 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9059a9f9-07d5-4daf-8795-b106a06ff02e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:18.318076 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9059a9f9-07d5-4daf-8795-b106a06ff02e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:18.334695 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-9059a9f9-07d5-4daf-8795-b106a06ff02e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1358 microversion: 2.1 time: 0.169087 May 19 06:34:18.335304 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 206/408] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:18 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:18.506475 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-55510612-29a0-4769-a3b5-eb00cf9e4c15 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:18.507277 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-55510612-29a0-4769-a3b5-eb00cf9e4c15 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:18.514636 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-55510612-29a0-4769-a3b5-eb00cf9e4c15 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:18.515089 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-55510612-29a0-4769-a3b5-eb00cf9e4c15 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:18.516359 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-55510612-29a0-4769-a3b5-eb00cf9e4c15 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:18.516920 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-55510612-29a0-4769-a3b5-eb00cf9e4c15 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:18.703579 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-55510612-29a0-4769-a3b5-eb00cf9e4c15 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:18.711452 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-55510612-29a0-4769-a3b5-eb00cf9e4c15 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1562 microversion: 2.1 time: 0.208716 May 19 06:34:18.712043 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 203/409] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:18 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1562 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:18.740368 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-eb854fc1-7f27-4c11-94be-5c2847d357d5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:18.741518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-eb854fc1-7f27-4c11-94be-5c2847d357d5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:18.751958 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb854fc1-7f27-4c11-94be-5c2847d357d5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:18.752542 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb854fc1-7f27-4c11-94be-5c2847d357d5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:18.753518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb854fc1-7f27-4c11-94be-5c2847d357d5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:18.754066 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb854fc1-7f27-4c11-94be-5c2847d357d5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:18.852951 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-eb854fc1-7f27-4c11-94be-5c2847d357d5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119149 May 19 06:34:18.853589 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 207/410] 10.222.0.65 () {58 vars in 1274 bytes} [Thu May 19 06:34:18 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:34:19.353056 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0f20f153-cd9a-4655-bae5-b3052b77bb35 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:19.353855 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0f20f153-cd9a-4655-bae5-b3052b77bb35 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:19.366265 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0f20f153-cd9a-4655-bae5-b3052b77bb35 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:19.367179 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0f20f153-cd9a-4655-bae5-b3052b77bb35 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:19.368209 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0f20f153-cd9a-4655-bae5-b3052b77bb35 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:19.368846 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0f20f153-cd9a-4655-bae5-b3052b77bb35 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:19.684577 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0f20f153-cd9a-4655-bae5-b3052b77bb35 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:19.709426 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0f20f153-cd9a-4655-bae5-b3052b77bb35 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1358 microversion: 2.1 time: 0.361013 May 19 06:34:19.718774 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 204/411] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:19 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1358 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:20.160651 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-6d345e69-e6a0-44a2-9225-417c32db403e req-77bb7a30-84bd-4bd3-b1e6-60b47e020053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e905065-4c72-403f-ba1f-3d56ec56b4f0", "tag": "e9987cd3-ff74-46e7-8754-720b4458b23e"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:34:20.169242 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-6d345e69-e6a0-44a2-9225-417c32db403e req-77bb7a30-84bd-4bd3-b1e6-60b47e020053 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:20.169738 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-6d345e69-e6a0-44a2-9225-417c32db403e req-77bb7a30-84bd-4bd3-b1e6-60b47e020053 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:20.174493 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:34:20.185137 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-6d345e69-e6a0-44a2-9225-417c32db403e req-77bb7a30-84bd-4bd3-b1e6-60b47e020053 service nova] Creating event network-changed:e9987cd3-ff74-46e7-8754-720b4458b23e for instance 3e905065-4c72-403f-ba1f-3d56ec56b4f0 on hv-cinder-83699 May 19 06:34:20.191699 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-6d345e69-e6a0-44a2-9225-417c32db403e req-77bb7a30-84bd-4bd3-b1e6-60b47e020053 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036187 May 19 06:34:20.192338 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 208/412] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:34:20.726740 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d2bada80-dcf6-4c99-8250-daf69b93b574 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:20.727442 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d2bada80-dcf6-4c99-8250-daf69b93b574 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:20.737369 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d2bada80-dcf6-4c99-8250-daf69b93b574 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:20.738365 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d2bada80-dcf6-4c99-8250-daf69b93b574 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:20.740659 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d2bada80-dcf6-4c99-8250-daf69b93b574 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:20.741324 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d2bada80-dcf6-4c99-8250-daf69b93b574 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:20.926496 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d2bada80-dcf6-4c99-8250-daf69b93b574 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:20.934679 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d2bada80-dcf6-4c99-8250-daf69b93b574 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1358 microversion: 2.1 time: 0.212131 May 19 06:34:20.935270 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 205/413] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:20 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:21.164699 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-01e9575f-0807-4a77-93c4-de2bc2c2f4f4 req-b526f261-bd71-4f98-a6fe-24b0c1870e06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "285cd5e6-76c3-491a-8b1d-23837478002a", "name": "network-vif-plugged", "status": "completed", "tag": "aaf80320-db37-4f95-9ea4-8a1de850bf84"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:34:21.176259 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-01e9575f-0807-4a77-93c4-de2bc2c2f4f4 req-b526f261-bd71-4f98-a6fe-24b0c1870e06 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:21.177142 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-01e9575f-0807-4a77-93c4-de2bc2c2f4f4 req-b526f261-bd71-4f98-a6fe-24b0c1870e06 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:21.192298 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-01e9575f-0807-4a77-93c4-de2bc2c2f4f4 req-b526f261-bd71-4f98-a6fe-24b0c1870e06 service nova] Creating event network-vif-plugged:aaf80320-db37-4f95-9ea4-8a1de850bf84 for instance 285cd5e6-76c3-491a-8b1d-23837478002a on hv-cinder-83699 May 19 06:34:21.200103 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-01e9575f-0807-4a77-93c4-de2bc2c2f4f4 req-b526f261-bd71-4f98-a6fe-24b0c1870e06 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040649 May 19 06:34:21.201196 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 209/414] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:34:21.952625 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-55eeeb1d-3d59-4fb0-9ff1-4032560e4be0 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:21.953700 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-55eeeb1d-3d59-4fb0-9ff1-4032560e4be0 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:21.960414 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-55eeeb1d-3d59-4fb0-9ff1-4032560e4be0 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:21.960867 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-55eeeb1d-3d59-4fb0-9ff1-4032560e4be0 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:21.961671 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-55eeeb1d-3d59-4fb0-9ff1-4032560e4be0 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:21.962109 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-55eeeb1d-3d59-4fb0-9ff1-4032560e4be0 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:21.978240 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=100 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:34:22.109072 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-55eeeb1d-3d59-4fb0-9ff1-4032560e4be0 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:22.117901 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-55eeeb1d-3d59-4fb0-9ff1-4032560e4be0 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1358 microversion: 2.1 time: 0.169239 May 19 06:34:22.118485 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 206/415] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:21 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:23.137824 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f255cbec-2582-4dc6-8d60-ceb602f32da1 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:23.138823 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f255cbec-2582-4dc6-8d60-ceb602f32da1 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:23.146797 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f255cbec-2582-4dc6-8d60-ceb602f32da1 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:23.147247 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f255cbec-2582-4dc6-8d60-ceb602f32da1 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:23.148026 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f255cbec-2582-4dc6-8d60-ceb602f32da1 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:23.148472 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f255cbec-2582-4dc6-8d60-ceb602f32da1 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:23.326227 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f255cbec-2582-4dc6-8d60-ceb602f32da1 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:23.349103 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f255cbec-2582-4dc6-8d60-ceb602f32da1 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1358 microversion: 2.1 time: 0.216143 May 19 06:34:23.350208 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 210/416] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:23 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:24.366349 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0f40aaba-9892-4deb-8458-d7538e0582ee tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:24.366955 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0f40aaba-9892-4deb-8458-d7538e0582ee tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:24.374078 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0f40aaba-9892-4deb-8458-d7538e0582ee tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:24.374526 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0f40aaba-9892-4deb-8458-d7538e0582ee tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:24.375330 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0f40aaba-9892-4deb-8458-d7538e0582ee tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:24.375792 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0f40aaba-9892-4deb-8458-d7538e0582ee tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:24.510676 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0f40aaba-9892-4deb-8458-d7538e0582ee tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:24.519465 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0f40aaba-9892-4deb-8458-d7538e0582ee tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1547 microversion: 2.1 time: 0.156894 May 19 06:34:24.520058 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 207/417] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:24 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:34:24.537111 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6ddc26f3-320c-464a-860d-52977ad30f8e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:24.537744 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6ddc26f3-320c-464a-860d-52977ad30f8e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:24.544481 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6ddc26f3-320c-464a-860d-52977ad30f8e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:24.545298 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6ddc26f3-320c-464a-860d-52977ad30f8e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:24.546173 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6ddc26f3-320c-464a-860d-52977ad30f8e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:24.546627 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6ddc26f3-320c-464a-860d-52977ad30f8e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:24.698855 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6ddc26f3-320c-464a-860d-52977ad30f8e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:24.707812 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6ddc26f3-320c-464a-860d-52977ad30f8e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1547 microversion: 2.1 time: 0.174354 May 19 06:34:24.708444 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 211/418] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:24 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1547 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:24.724844 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1f669424-a470-4f76-bd95-d48c9e7d0786 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:24.728991 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1f669424-a470-4f76-bd95-d48c9e7d0786 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:24.729800 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1f669424-a470-4f76-bd95-d48c9e7d0786 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Searching by: {'deleted': False, 'project_id': '14bd96bd91c44b888074b760e9834814'} {{(pid=117712) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 06:34:24.739277 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1f669424-a470-4f76-bd95-d48c9e7d0786 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:24.739738 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1f669424-a470-4f76-bd95-d48c9e7d0786 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:24.741561 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1f669424-a470-4f76-bd95-d48c9e7d0786 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:24.741999 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1f669424-a470-4f76-bd95-d48c9e7d0786 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:24.833896 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.multi_cell_list [None req-1f669424-a470-4f76-bd95-d48c9e7d0786 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117712) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 06:34:24.936447 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1f669424-a470-4f76-bd95-d48c9e7d0786 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.215363 May 19 06:34:24.937035 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 208/419] 10.222.0.65 () {58 vars in 1124 bytes} [Thu May 19 06:34:24 2022] GET /compute/v2.1/servers => generated 342 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:34:24.947675 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-66dcaa2b-d419-40e3-8038-3f6dff3dd7a2 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:24.948308 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-66dcaa2b-d419-40e3-8038-3f6dff3dd7a2 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:24.955485 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-66dcaa2b-d419-40e3-8038-3f6dff3dd7a2 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:24.955919 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-66dcaa2b-d419-40e3-8038-3f6dff3dd7a2 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:24.956697 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-66dcaa2b-d419-40e3-8038-3f6dff3dd7a2 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:24.957132 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-66dcaa2b-d419-40e3-8038-3f6dff3dd7a2 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:25.106472 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-66dcaa2b-d419-40e3-8038-3f6dff3dd7a2 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:25.114553 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-66dcaa2b-d419-40e3-8038-3f6dff3dd7a2 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1547 microversion: 2.1 time: 0.170664 May 19 06:34:25.115143 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 212/420] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:24 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1547 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:26.598288 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b86cb25d-0cfe-46a0-b1fb-19e267e355db tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:26.598911 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b86cb25d-0cfe-46a0-b1fb-19e267e355db tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:26.606027 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b86cb25d-0cfe-46a0-b1fb-19e267e355db tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:26.606475 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b86cb25d-0cfe-46a0-b1fb-19e267e355db tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:26.607268 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b86cb25d-0cfe-46a0-b1fb-19e267e355db tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:26.607694 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b86cb25d-0cfe-46a0-b1fb-19e267e355db tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:26.634969 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b86cb25d-0cfe-46a0-b1fb-19e267e355db tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd/ips" status: 200 len: 148 microversion: 2.1 time: 0.040936 May 19 06:34:26.635572 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 209/421] 10.222.0.65 () {58 vars in 1247 bytes} [Thu May 19 06:34:26 2022] GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:34:26.647105 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7efc8910-993a-4777-a847-3d3b8800bbe9 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8b89adf-9170-4772-91d0-d2aa6f49d216"}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:34:26.648346 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7efc8910-993a-4777-a847-3d3b8800bbe9 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:26.656775 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7efc8910-993a-4777-a847-3d3b8800bbe9 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:26.657371 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7efc8910-993a-4777-a847-3d3b8800bbe9 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:26.658297 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7efc8910-993a-4777-a847-3d3b8800bbe9 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:26.659077 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7efc8910-993a-4777-a847-3d3b8800bbe9 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:26.750746 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-7efc8910-993a-4777-a847-3d3b8800bbe9 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] HTTP exception thrown: Invalid volume: volume e8b89adf-9170-4772-91d0-d2aa6f49d216 is already attached to instances: 27482c04-b2af-4f4a-be37-655969d386cf May 19 06:34:26.753106 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7efc8910-993a-4777-a847-3d3b8800bbe9 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Request method failure captured: May 19 06:34:26.753106 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: POST /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd/os-volume_attachments HTTP/1.1 May 19 06:34:26.753106 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:34:26.753106 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:34:26.753106 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:34:26.753106 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 74 May 19 06:34:26.753106 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:34:26.753106 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:34:26.753106 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:34:26.753106 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:34:26.753106 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheQpEYHNc-bqZDbTw7Fp3ihyV0ldXUTzVqdWql59X0rABgHWrMJ_mmqGdwFukt62XCeg2LJEaWYizlEXJ-MFBwGucN9hE2YUn-VSsy8oJQ2x49K6gk4QQGlP2u7BGs_KXICLfWCW8W72y7YMhrOqThFt82dOSFW0U-RORzkOxIAljYo May 19 06:34:26.753106 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:34:26.753106 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:34:26.753106 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:34:26.753106 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:34:26.753106 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:34:26.753106 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:34:26.753106 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: adbcff8654844c22a906a2e91ebca3bb May 19 06:34:26.753106 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-AttachVolumeNegativeTest-624051308 May 19 06:34:26.753106 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:34:26.753106 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:34:26.754725 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_adbcff8654844c22a906a2e91ebca3bb", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:34:26.754725 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-AttachVolumeNegativeTest-624051308 May 19 06:34:26.754725 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: adbcff8654844c22a906a2e91ebca3bb May 19 06:34:26.754725 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-624051308 May 19 06:34:26.754725 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-AttachVolumeNegativeTest-624051308-project May 19 06:34:26.754725 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:34:26.754725 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:34:26.754725 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: cb2bf8531dfe42b29b0b632b39d49625 May 19 06:34:26.754725 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-AttachVolumeNegativeTest-624051308-project May 19 06:34:26.754725 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: May 19 06:34:26.754725 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {"volumeAttachment": {"volumeId": "e8b89adf-9170-4772-91d0-d2aa6f49d216"}} May 19 06:34:26.754725 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: > May 19 06:34:26.755931 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Invalid volume: volume e8b89adf-9170-4772-91d0-d2aa6f49d216 is already attached to instances: 27482c04-b2af-4f4a-be37-655969d386cf May 19 06:34:26.755931 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'server_id': 'e8943880-a4d3-49d5-8c02-88ff7343f5fd', 'body': {'volumeAttachment': {'volumeId': 'e8b89adf-9170-4772-91d0-d2aa6f49d216'}}} May 19 06:34:26.755931 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:34:26.755931 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:34:26.755931 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 19 06:34:26.755931 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 19 06:34:26.755931 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 06:34:26.755931 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 06:34:26.755931 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 19 06:34:26.755931 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 06:34:26.755931 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 19 06:34:26.755931 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 19 06:34:26.755931 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 19 06:34:26.755931 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 19 06:34:26.755931 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e8b89adf-9170-4772-91d0-d2aa6f49d216 is already attached to instances: 27482c04-b2af-4f4a-be37-655969d386cf May 19 06:34:26.755931 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:34:26.755931 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:34:26.755931 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:34:26.755931 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:34:26.757400 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:34:26.757400 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:34:26.757400 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:34:26.757400 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:34:26.757400 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:34:26.757400 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:34:26.757400 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 06:34:26.757400 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 06:34:26.757400 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 06:34:26.757400 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 06:34:26.757400 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 06:34:26.757400 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 06:34:26.757400 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 19 06:34:26.757400 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 19 06:34:26.757400 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e8b89adf-9170-4772-91d0-d2aa6f49d216 is already attached to instances: 27482c04-b2af-4f4a-be37-655969d386cf May 19 06:34:26.757400 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:34:26.757400 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:34:26.757400 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:34:26.757400 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:34:26.757400 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:34:26.759032 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:34:26.759032 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:34:26.759032 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:34:26.759032 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e8b89adf-9170-4772-91d0-d2aa6f49d216 is already attached to instances: 27482c04-b2af-4f4a-be37-655969d386cf May 19 06:34:26.759032 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:34:26.759032 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7efc8910-993a-4777-a847-3d3b8800bbe9 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Returning 400 to user: Invalid volume: volume e8b89adf-9170-4772-91d0-d2aa6f49d216 is already attached to instances: 27482c04-b2af-4f4a-be37-655969d386cf {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:34:26.759032 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7efc8910-993a-4777-a847-3d3b8800bbe9 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "POST /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111960 May 19 06:34:26.759032 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 213/422] 10.222.0.65 () {60 vars in 1322 bytes} [Thu May 19 06:34:26 2022] POST /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 06:34:26.763845 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9ad3c96d-8cee-4e6b-bf41-0b0840c778ff tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:26.764348 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9ad3c96d-8cee-4e6b-bf41-0b0840c778ff tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:26.772019 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9ad3c96d-8cee-4e6b-bf41-0b0840c778ff tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:26.772469 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9ad3c96d-8cee-4e6b-bf41-0b0840c778ff tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:26.773248 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9ad3c96d-8cee-4e6b-bf41-0b0840c778ff tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:26.773716 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9ad3c96d-8cee-4e6b-bf41-0b0840c778ff tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:26.802467 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9ad3c96d-8cee-4e6b-bf41-0b0840c778ff tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Going to try to terminate instance {{(pid=117712) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 06:34:26.846567 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-2633edff-0682-4909-9696-b99e7aa183f3 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc6f2104-8f61-413f-9c2f-d2f122bf1bfa"}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:34:26.847807 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-2633edff-0682-4909-9696-b99e7aa183f3 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:26.855592 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2633edff-0682-4909-9696-b99e7aa183f3 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:26.855970 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2633edff-0682-4909-9696-b99e7aa183f3 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:26.856775 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2633edff-0682-4909-9696-b99e7aa183f3 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:26.857219 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2633edff-0682-4909-9696-b99e7aa183f3 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:26.892479 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9ad3c96d-8cee-4e6b-bf41-0b0840c778ff tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd" status: 204 len: 0 microversion: 2.1 time: 0.131682 May 19 06:34:26.892727 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 210/423] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 06:34:26 2022] DELETE /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 06:34:26.901846 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-baf53d1d-2c59-45b3-97dd-4ccfe78531e4 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:26.902603 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-baf53d1d-2c59-45b3-97dd-4ccfe78531e4 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:26.908775 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-baf53d1d-2c59-45b3-97dd-4ccfe78531e4 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:26.909223 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-baf53d1d-2c59-45b3-97dd-4ccfe78531e4 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:26.910069 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-baf53d1d-2c59-45b3-97dd-4ccfe78531e4 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:26.910501 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-baf53d1d-2c59-45b3-97dd-4ccfe78531e4 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:27.054690 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-baf53d1d-2c59-45b3-97dd-4ccfe78531e4 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:27.063456 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-baf53d1d-2c59-45b3-97dd-4ccfe78531e4 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd" status: 200 len: 1680 microversion: 2.1 time: 0.166261 May 19 06:34:27.064040 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 211/424] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:26 2022] GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:34:28.082232 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d2e2d9ec-b927-487c-b9f3-0ac0f8cb109b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:28.082874 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d2e2d9ec-b927-487c-b9f3-0ac0f8cb109b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:28.089636 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d2e2d9ec-b927-487c-b9f3-0ac0f8cb109b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:28.090085 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d2e2d9ec-b927-487c-b9f3-0ac0f8cb109b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:28.090863 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d2e2d9ec-b927-487c-b9f3-0ac0f8cb109b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:28.091294 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d2e2d9ec-b927-487c-b9f3-0ac0f8cb109b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:28.236765 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d2e2d9ec-b927-487c-b9f3-0ac0f8cb109b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:28.244435 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d2e2d9ec-b927-487c-b9f3-0ac0f8cb109b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd" status: 200 len: 1680 microversion: 2.1 time: 0.166735 May 19 06:34:28.245002 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 212/425] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:28 2022] GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:28.572720 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-2633edff-0682-4909-9696-b99e7aa183f3 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "POST /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.730728 May 19 06:34:28.573397 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 214/426] 10.222.0.65 () {60 vars in 1322 bytes} [Thu May 19 06:34:26 2022] POST /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a/os-volume_attachments => generated 194 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:34:29.269439 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f772b9b3-0f08-4b4c-82cc-c5797d133ec8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:29.269439 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f772b9b3-0f08-4b4c-82cc-c5797d133ec8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:29.269439 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f772b9b3-0f08-4b4c-82cc-c5797d133ec8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:29.270208 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f772b9b3-0f08-4b4c-82cc-c5797d133ec8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:29.270957 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f772b9b3-0f08-4b4c-82cc-c5797d133ec8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:29.271394 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f772b9b3-0f08-4b4c-82cc-c5797d133ec8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:29.445099 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f772b9b3-0f08-4b4c-82cc-c5797d133ec8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:29.451428 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f772b9b3-0f08-4b4c-82cc-c5797d133ec8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd" status: 200 len: 1680 microversion: 2.1 time: 0.193300 May 19 06:34:29.461934 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 213/427] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:29 2022] GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd => generated 1680 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:29.779329 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-83eb252a-3498-46aa-a41c-109f9885cc6c req-583ea1dc-18e4-4030-b988-567640a07871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8943880-a4d3-49d5-8c02-88ff7343f5fd", "name": "network-vif-deleted", "tag": "f34db898-32c0-4c35-871a-443b193021aa"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:34:29.798210 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-83eb252a-3498-46aa-a41c-109f9885cc6c req-583ea1dc-18e4-4030-b988-567640a07871 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:29.798923 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-83eb252a-3498-46aa-a41c-109f9885cc6c req-583ea1dc-18e4-4030-b988-567640a07871 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:29.811641 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-83eb252a-3498-46aa-a41c-109f9885cc6c req-583ea1dc-18e4-4030-b988-567640a07871 service nova] Creating event network-vif-deleted:f34db898-32c0-4c35-871a-443b193021aa for instance e8943880-a4d3-49d5-8c02-88ff7343f5fd on hv-cinder-83699 May 19 06:34:29.818655 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-83eb252a-3498-46aa-a41c-109f9885cc6c req-583ea1dc-18e4-4030-b988-567640a07871 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045286 May 19 06:34:29.820177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 215/428] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:34:30.471803 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-78aabbdd-7c52-482f-97dc-8020f254dbfc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:30.473127 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-78aabbdd-7c52-482f-97dc-8020f254dbfc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:30.480342 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-78aabbdd-7c52-482f-97dc-8020f254dbfc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:30.480805 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-78aabbdd-7c52-482f-97dc-8020f254dbfc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:30.481696 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-78aabbdd-7c52-482f-97dc-8020f254dbfc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:30.482127 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-78aabbdd-7c52-482f-97dc-8020f254dbfc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:30.498691 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-78aabbdd-7c52-482f-97dc-8020f254dbfc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] HTTP exception thrown: Instance e8943880-a4d3-49d5-8c02-88ff7343f5fd could not be found. May 19 06:34:30.501187 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-78aabbdd-7c52-482f-97dc-8020f254dbfc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Request method failure captured: May 19 06:34:30.501187 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd HTTP/1.1 May 19 06:34:30.501187 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept: application/json May 19 06:34:30.501187 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity May 19 06:34:30.501187 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Connection: close May 19 06:34:30.501187 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Length: 0 May 19 06:34:30.501187 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Type: application/json May 19 06:34:30.501187 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Host: 10.222.0.65 May 19 06:34:30.501187 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None May 19 06:34:30.501187 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 May 19 06:34:30.501187 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiheQpEYHNc-bqZDbTw7Fp3ihyV0ldXUTzVqdWql59X0rABgHWrMJ_mmqGdwFukt62XCeg2LJEaWYizlEXJ-MFBwGucN9hE2YUn-VSsy8oJQ2x49K6gk4QQGlP2u7BGs_KXICLfWCW8W72y7YMhrOqThFt82dOSFW0U-RORzkOxIAljYo May 19 06:34:30.501187 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Id: None May 19 06:34:30.501187 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Name: None May 19 06:34:30.501187 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed May 19 06:34:30.501187 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True May 19 06:34:30.501187 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default May 19 06:34:30.501187 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default May 19 06:34:30.501187 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Id: adbcff8654844c22a906a2e91ebca3bb May 19 06:34:30.501187 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-AttachVolumeNegativeTest-624051308 May 19 06:34:30.501187 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Role: reader,member May 19 06:34:30.501187 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Roles: reader,member May 19 06:34:30.502536 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_adbcff8654844c22a906a2e91ebca3bb", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:34:30.502536 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-AttachVolumeNegativeTest-624051308 May 19 06:34:30.502536 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Id: adbcff8654844c22a906a2e91ebca3bb May 19 06:34:30.502536 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-624051308 May 19 06:34:30.502536 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User: tempest-AttachVolumeNegativeTest-624051308-project May 19 06:34:30.502536 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default May 19 06:34:30.502536 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default May 19 06:34:30.502536 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Id: cb2bf8531dfe42b29b0b632b39d49625 May 19 06:34:30.502536 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-AttachVolumeNegativeTest-624051308-project May 19 06:34:30.502536 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: method: > May 19 06:34:30.502536 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: exception: Instance e8943880-a4d3-49d5-8c02-88ff7343f5fd could not be found. May 19 06:34:30.502536 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: action_args: {'id': 'e8943880-a4d3-49d5-8c02-88ff7343f5fd'} May 19 06:34:30.503254 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:34:30.503254 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:34:30.503254 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:34:30.503254 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:34:30.503254 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:34:30.503254 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:34:30.503254 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:34:30.503254 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:34:30.503254 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:34:30.503254 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:34:30.503254 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8943880-a4d3-49d5-8c02-88ff7343f5fd could not be found. May 19 06:34:30.503254 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:34:30.503254 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:34:30.503254 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:34:30.503254 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:34:30.503254 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:34:30.503254 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:34:30.503254 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:34:30.503254 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:34:30.503254 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:34:30.504410 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:34:30.504410 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:34:30.504410 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:34:30.504410 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:34:30.504410 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:34:30.504410 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:34:30.504410 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:34:30.504410 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8943880-a4d3-49d5-8c02-88ff7343f5fd could not be found. May 19 06:34:30.504410 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:34:30.504410 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:34:30.504410 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:34:30.504410 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:34:30.504410 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:34:30.504410 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:34:30.504410 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:34:30.504410 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:34:30.504410 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8943880-a4d3-49d5-8c02-88ff7343f5fd could not be found. May 19 06:34:30.504410 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:34:30.505513 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-78aabbdd-7c52-482f-97dc-8020f254dbfc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Returning 404 to user: Instance e8943880-a4d3-49d5-8c02-88ff7343f5fd could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:34:30.505513 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-78aabbdd-7c52-482f-97dc-8020f254dbfc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd" status: 404 len: 111 microversion: 2.1 time: 0.037167 May 19 06:34:30.505513 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 214/429] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:30 2022] GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:34:30.513350 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5c57e213-62c8-4ad4-8391-ee13a5bf6488 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '.version_select at 0x7f9aeb6f81f0>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:30.535918 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5c57e213-62c8-4ad4-8391-ee13a5bf6488 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1444113227" status: 202 len: 0 microversion: 2.1 time: 0.027320 May 19 06:34:30.536512 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 216/430] 10.222.0.65 () {58 vars in 1220 bytes} [Thu May 19 06:34:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1444113227 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 06:34:31.468877 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-74831ab6-f06a-4c1a-87aa-c1bb8a9020a4 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:31.469681 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-74831ab6-f06a-4c1a-87aa-c1bb8a9020a4 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:31.476643 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-74831ab6-f06a-4c1a-87aa-c1bb8a9020a4 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:31.477223 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-74831ab6-f06a-4c1a-87aa-c1bb8a9020a4 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:31.477918 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-74831ab6-f06a-4c1a-87aa-c1bb8a9020a4 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:31.478357 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-74831ab6-f06a-4c1a-87aa-c1bb8a9020a4 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:31.612999 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-74831ab6-f06a-4c1a-87aa-c1bb8a9020a4 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lazy-loading 'services' on Instance uuid 27482c04-b2af-4f4a-be37-655969d386cf {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:34:31.735946 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-74831ab6-f06a-4c1a-87aa-c1bb8a9020a4 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "DELETE /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf/os-volume_attachments/e8b89adf-9170-4772-91d0-d2aa6f49d216" status: 202 len: 0 microversion: 2.1 time: 0.271009 May 19 06:34:31.736521 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 215/431] 10.222.0.65 () {58 vars in 1415 bytes} [Thu May 19 06:34:31 2022] DELETE /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf/os-volume_attachments/e8b89adf-9170-4772-91d0-d2aa6f49d216 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 06:34:31.747818 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-60a588a1-a950-4be9-baf9-11a9164e31e2 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:31.750230 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-60a588a1-a950-4be9-baf9-11a9164e31e2 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:31.761091 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-60a588a1-a950-4be9-baf9-11a9164e31e2 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:31.761776 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-60a588a1-a950-4be9-baf9-11a9164e31e2 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:31.762627 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-60a588a1-a950-4be9-baf9-11a9164e31e2 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:31.763863 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-60a588a1-a950-4be9-baf9-11a9164e31e2 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:31.818861 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-60a588a1-a950-4be9-baf9-11a9164e31e2 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076216 May 19 06:34:31.819440 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 217/432] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 06:34:31 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:34:32.831731 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b162becb-3219-4a89-8ab2-055a03703c17 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:32.832800 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b162becb-3219-4a89-8ab2-055a03703c17 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:32.839714 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b162becb-3219-4a89-8ab2-055a03703c17 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:32.840155 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b162becb-3219-4a89-8ab2-055a03703c17 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:32.840920 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b162becb-3219-4a89-8ab2-055a03703c17 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:32.841376 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b162becb-3219-4a89-8ab2-055a03703c17 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:32.880389 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b162becb-3219-4a89-8ab2-055a03703c17 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053451 May 19 06:34:32.880765 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 216/433] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 06:34:32 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:34:33.893709 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0b329b8f-4110-420f-9f09-35ad9ce68ad8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:33.894127 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0b329b8f-4110-420f-9f09-35ad9ce68ad8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:33.896710 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:34:33.902989 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0b329b8f-4110-420f-9f09-35ad9ce68ad8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:33.903595 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0b329b8f-4110-420f-9f09-35ad9ce68ad8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:33.904384 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0b329b8f-4110-420f-9f09-35ad9ce68ad8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:33.904818 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0b329b8f-4110-420f-9f09-35ad9ce68ad8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:33.944693 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0b329b8f-4110-420f-9f09-35ad9ce68ad8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056654 May 19 06:34:33.945539 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 218/434] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 06:34:33 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:34:34.957383 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e1ebf9e0-ef1d-42fb-8003-e876b8c48c08 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:34.958613 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e1ebf9e0-ef1d-42fb-8003-e876b8c48c08 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:34.961094 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:34:34.967202 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e1ebf9e0-ef1d-42fb-8003-e876b8c48c08 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:34.967202 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e1ebf9e0-ef1d-42fb-8003-e876b8c48c08 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:34.968113 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e1ebf9e0-ef1d-42fb-8003-e876b8c48c08 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:34.968645 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e1ebf9e0-ef1d-42fb-8003-e876b8c48c08 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:35.001847 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e1ebf9e0-ef1d-42fb-8003-e876b8c48c08 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049084 May 19 06:34:35.005773 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 217/435] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 06:34:34 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:34:36.013560 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-cc50c244-52b4-422b-bc7a-ee73c9e2d17c tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:36.014486 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-cc50c244-52b4-422b-bc7a-ee73c9e2d17c tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:36.021071 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cc50c244-52b4-422b-bc7a-ee73c9e2d17c tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:36.021566 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cc50c244-52b4-422b-bc7a-ee73c9e2d17c tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:36.022369 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cc50c244-52b4-422b-bc7a-ee73c9e2d17c tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:36.022884 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cc50c244-52b4-422b-bc7a-ee73c9e2d17c tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:36.063142 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-cc50c244-52b4-422b-bc7a-ee73c9e2d17c tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047423 May 19 06:34:36.063142 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 219/436] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 06:34:36 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:34:36.291318 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7ccffed0-065a-4be9-9212-0b33fa4a5f4f tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:36.291932 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7ccffed0-065a-4be9-9212-0b33fa4a5f4f tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:36.298957 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7ccffed0-065a-4be9-9212-0b33fa4a5f4f tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:36.299399 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7ccffed0-065a-4be9-9212-0b33fa4a5f4f tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:36.300169 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7ccffed0-065a-4be9-9212-0b33fa4a5f4f tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:36.300597 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7ccffed0-065a-4be9-9212-0b33fa4a5f4f tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:36.461382 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7ccffed0-065a-4be9-9212-0b33fa4a5f4f tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:36.471694 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7ccffed0-065a-4be9-9212-0b33fa4a5f4f tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1593 microversion: 2.1 time: 0.184392 May 19 06:34:36.472796 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 218/437] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:36 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1593 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:37.068346 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-bcf59cce-42b9-4856-a138-61211dd40174 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:37.069483 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-bcf59cce-42b9-4856-a138-61211dd40174 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:37.076167 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bcf59cce-42b9-4856-a138-61211dd40174 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:37.076766 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bcf59cce-42b9-4856-a138-61211dd40174 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:37.078187 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bcf59cce-42b9-4856-a138-61211dd40174 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:37.078717 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bcf59cce-42b9-4856-a138-61211dd40174 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:37.109090 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-bcf59cce-42b9-4856-a138-61211dd40174 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044669 May 19 06:34:37.109959 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 220/438] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 06:34:37 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 06:34:37.171831 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1758aeeb-8302-4980-9383-9603337ecdc8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:37.172401 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1758aeeb-8302-4980-9383-9603337ecdc8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:37.179836 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1758aeeb-8302-4980-9383-9603337ecdc8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:37.180371 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1758aeeb-8302-4980-9383-9603337ecdc8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:37.181329 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1758aeeb-8302-4980-9383-9603337ecdc8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:37.181858 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1758aeeb-8302-4980-9383-9603337ecdc8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:37.209896 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1758aeeb-8302-4980-9383-9603337ecdc8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Going to try to terminate instance {{(pid=117712) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 06:34:37.263379 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:34:37.294860 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1758aeeb-8302-4980-9383-9603337ecdc8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "DELETE /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf" status: 204 len: 0 microversion: 2.1 time: 0.126692 May 19 06:34:37.295564 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 219/439] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 06:34:37 2022] DELETE /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 06:34:37.304689 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-50058325-f988-45d5-b260-454fd55660ae tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:37.305516 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-50058325-f988-45d5-b260-454fd55660ae tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:37.319721 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-50058325-f988-45d5-b260-454fd55660ae tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:37.320063 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-50058325-f988-45d5-b260-454fd55660ae tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:37.320838 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-50058325-f988-45d5-b260-454fd55660ae tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:37.321262 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-50058325-f988-45d5-b260-454fd55660ae tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:37.603909 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-50058325-f988-45d5-b260-454fd55660ae tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:37.623036 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-50058325-f988-45d5-b260-454fd55660ae tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf" status: 200 len: 1679 microversion: 2.1 time: 0.322119 May 19 06:34:37.623743 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 221/440] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:37 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf => generated 1679 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:34:38.538837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-7d07266c-c95d-431d-8ec8-59777e2e59d3 req-f8854389-bfd1-41c0-bb55-edb30496098b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "285cd5e6-76c3-491a-8b1d-23837478002a", "tag": "aaf80320-db37-4f95-9ea4-8a1de850bf84"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:34:38.547804 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-7d07266c-c95d-431d-8ec8-59777e2e59d3 req-f8854389-bfd1-41c0-bb55-edb30496098b service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:38.548335 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-7d07266c-c95d-431d-8ec8-59777e2e59d3 req-f8854389-bfd1-41c0-bb55-edb30496098b service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:38.560047 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-7d07266c-c95d-431d-8ec8-59777e2e59d3 req-f8854389-bfd1-41c0-bb55-edb30496098b service nova] Creating event network-changed:aaf80320-db37-4f95-9ea4-8a1de850bf84 for instance 285cd5e6-76c3-491a-8b1d-23837478002a on hv-cinder-83699 May 19 06:34:38.567643 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-7d07266c-c95d-431d-8ec8-59777e2e59d3 req-f8854389-bfd1-41c0-bb55-edb30496098b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032787 May 19 06:34:38.568571 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 220/441] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:34:38.643822 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e57c9cc6-3e24-47fa-b97e-d2f42f4b4031 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:38.644825 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e57c9cc6-3e24-47fa-b97e-d2f42f4b4031 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:38.654021 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e57c9cc6-3e24-47fa-b97e-d2f42f4b4031 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:38.654524 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e57c9cc6-3e24-47fa-b97e-d2f42f4b4031 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:38.655541 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e57c9cc6-3e24-47fa-b97e-d2f42f4b4031 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:38.657054 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e57c9cc6-3e24-47fa-b97e-d2f42f4b4031 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:38.859987 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e57c9cc6-3e24-47fa-b97e-d2f42f4b4031 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:38.873043 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e57c9cc6-3e24-47fa-b97e-d2f42f4b4031 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf" status: 200 len: 1679 microversion: 2.1 time: 0.235507 May 19 06:34:38.875614 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 222/442] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:38 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf => generated 1679 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:39.893545 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-04ba66dc-581d-4f39-a4ab-4fca6b99faf8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:39.894266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-04ba66dc-581d-4f39-a4ab-4fca6b99faf8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:39.914366 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-04ba66dc-581d-4f39-a4ab-4fca6b99faf8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:39.915307 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-04ba66dc-581d-4f39-a4ab-4fca6b99faf8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:39.917820 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-04ba66dc-581d-4f39-a4ab-4fca6b99faf8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:39.918841 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-04ba66dc-581d-4f39-a4ab-4fca6b99faf8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:40.160111 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-04ba66dc-581d-4f39-a4ab-4fca6b99faf8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:40.168732 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-04ba66dc-581d-4f39-a4ab-4fca6b99faf8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf" status: 200 len: 1679 microversion: 2.1 time: 0.281107 May 19 06:34:40.179600 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 221/443] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:39 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf => generated 1679 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:40.754329 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f676bd6b-4101-411a-9e13-ff12a7660dc3 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-816447210"}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:34:40.755007 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f676bd6b-4101-411a-9e13-ff12a7660dc3 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:40.761776 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f676bd6b-4101-411a-9e13-ff12a7660dc3 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:40.762304 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f676bd6b-4101-411a-9e13-ff12a7660dc3 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:40.764182 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f676bd6b-4101-411a-9e13-ff12a7660dc3 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:40.764697 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f676bd6b-4101-411a-9e13-ff12a7660dc3 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:41.003645 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.network.security_group_api [None req-f676bd6b-4101-411a-9e13-ff12a7660dc3 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Adding security group 26b28be4-af3c-435b-8888-d8cf4b82bfcd to port aaf80320-db37-4f95-9ea4-8a1de850bf84 May 19 06:34:41.188206 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1722893c-79df-495f-91e9-69e04d6b9909 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:41.188987 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1722893c-79df-495f-91e9-69e04d6b9909 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:41.195890 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1722893c-79df-495f-91e9-69e04d6b9909 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:41.196470 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1722893c-79df-495f-91e9-69e04d6b9909 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:41.197370 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1722893c-79df-495f-91e9-69e04d6b9909 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:41.197907 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1722893c-79df-495f-91e9-69e04d6b9909 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:41.268134 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1722893c-79df-495f-91e9-69e04d6b9909 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:41.276963 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1722893c-79df-495f-91e9-69e04d6b9909 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf" status: 200 len: 1611 microversion: 2.1 time: 0.093132 May 19 06:34:41.278079 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 222/444] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:41 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf => generated 1611 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:34:41.610826 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-a03f598b-26f7-4147-a8d3-e6a471b7b1ba req-f06a5c90-6345-4a55-a5e5-be0252b04ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27482c04-b2af-4f4a-be37-655969d386cf", "name": "network-vif-deleted", "tag": "cb1871e1-4ddc-43af-a6f0-08f3745f2edf"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:34:41.621009 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-a03f598b-26f7-4147-a8d3-e6a471b7b1ba req-f06a5c90-6345-4a55-a5e5-be0252b04ae5 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:41.621720 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-a03f598b-26f7-4147-a8d3-e6a471b7b1ba req-f06a5c90-6345-4a55-a5e5-be0252b04ae5 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:41.637996 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-a03f598b-26f7-4147-a8d3-e6a471b7b1ba req-f06a5c90-6345-4a55-a5e5-be0252b04ae5 service nova] Creating event network-vif-deleted:cb1871e1-4ddc-43af-a6f0-08f3745f2edf for instance 27482c04-b2af-4f4a-be37-655969d386cf on hv-cinder-83699 May 19 06:34:41.645190 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-a03f598b-26f7-4147-a8d3-e6a471b7b1ba req-f06a5c90-6345-4a55-a5e5-be0252b04ae5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038935 May 19 06:34:41.646544 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 223/445] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:34:41.701323 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f676bd6b-4101-411a-9e13-ff12a7660dc3 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "POST /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a/action" status: 202 len: 0 microversion: 2.1 time: 0.951588 May 19 06:34:41.701552 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 223/446] 10.222.0.65 () {60 vars in 1277 bytes} [Thu May 19 06:34:40 2022] POST /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a/action => generated 0 bytes in 953 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 06:34:41.711343 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-bcb5d635-a6bc-4e68-b39e-acb503fa54ef tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:41.712371 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-bcb5d635-a6bc-4e68-b39e-acb503fa54ef tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:41.721851 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bcb5d635-a6bc-4e68-b39e-acb503fa54ef tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:41.722833 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bcb5d635-a6bc-4e68-b39e-acb503fa54ef tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:41.727079 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bcb5d635-a6bc-4e68-b39e-acb503fa54ef tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:41.727757 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bcb5d635-a6bc-4e68-b39e-acb503fa54ef tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:41.925765 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-bcb5d635-a6bc-4e68-b39e-acb503fa54ef tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:41.935491 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-bcb5d635-a6bc-4e68-b39e-acb503fa54ef tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1639 microversion: 2.1 time: 0.228816 May 19 06:34:41.936421 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 224/447] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:41 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1639 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:42.298879 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f56cdfd2-6581-450f-b7b0-2f2d1181b97b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:42.299530 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f56cdfd2-6581-450f-b7b0-2f2d1181b97b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:42.305642 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f56cdfd2-6581-450f-b7b0-2f2d1181b97b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:42.306085 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f56cdfd2-6581-450f-b7b0-2f2d1181b97b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:42.306843 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f56cdfd2-6581-450f-b7b0-2f2d1181b97b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:42.307288 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f56cdfd2-6581-450f-b7b0-2f2d1181b97b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:42.392260 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f56cdfd2-6581-450f-b7b0-2f2d1181b97b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:42.400449 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f56cdfd2-6581-450f-b7b0-2f2d1181b97b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf" status: 200 len: 1611 microversion: 2.1 time: 0.107995 May 19 06:34:42.410969 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 224/448] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:42 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf => generated 1611 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:43.427135 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6d42bbb4-f81c-41aa-98ca-981e158567c8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:43.428598 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-6d42bbb4-f81c-41aa-98ca-981e158567c8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:43.433483 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:34:43.453341 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6d42bbb4-f81c-41aa-98ca-981e158567c8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:43.454240 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6d42bbb4-f81c-41aa-98ca-981e158567c8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:43.455761 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6d42bbb4-f81c-41aa-98ca-981e158567c8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:43.457205 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6d42bbb4-f81c-41aa-98ca-981e158567c8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:43.515834 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6d42bbb4-f81c-41aa-98ca-981e158567c8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:43.516375 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6d42bbb4-f81c-41aa-98ca-981e158567c8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:43.516929 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-6d42bbb4-f81c-41aa-98ca-981e158567c8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lazy-loading 'fault' on Instance uuid 27482c04-b2af-4f4a-be37-655969d386cf {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:34:43.562948 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6d42bbb4-f81c-41aa-98ca-981e158567c8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:43.571212 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6d42bbb4-f81c-41aa-98ca-981e158567c8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf" status: 200 len: 1330 microversion: 2.1 time: 0.154836 May 19 06:34:43.571742 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 225/449] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:43 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf => generated 1330 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:43.687525 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-9d501110-5639-4e78-8036-87c2b146deab req-225a8ed6-d180-4fe4-9473-5ae66357de13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "285cd5e6-76c3-491a-8b1d-23837478002a", "tag": "aaf80320-db37-4f95-9ea4-8a1de850bf84"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:34:43.697852 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-9d501110-5639-4e78-8036-87c2b146deab req-225a8ed6-d180-4fe4-9473-5ae66357de13 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:43.698843 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-9d501110-5639-4e78-8036-87c2b146deab req-225a8ed6-d180-4fe4-9473-5ae66357de13 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:43.712469 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-9d501110-5639-4e78-8036-87c2b146deab req-225a8ed6-d180-4fe4-9473-5ae66357de13 service nova] Creating event network-changed:aaf80320-db37-4f95-9ea4-8a1de850bf84 for instance 285cd5e6-76c3-491a-8b1d-23837478002a on hv-cinder-83699 May 19 06:34:43.719390 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-9d501110-5639-4e78-8036-87c2b146deab req-225a8ed6-d180-4fe4-9473-5ae66357de13 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035983 May 19 06:34:43.719907 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 225/450] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:34:44.588777 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9cbce605-a822-4ba4-bb1e-53ed9ec34b4c tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:44.589424 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9cbce605-a822-4ba4-bb1e-53ed9ec34b4c tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:44.595896 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9cbce605-a822-4ba4-bb1e-53ed9ec34b4c tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:44.596341 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9cbce605-a822-4ba4-bb1e-53ed9ec34b4c tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:44.597126 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9cbce605-a822-4ba4-bb1e-53ed9ec34b4c tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:44.597582 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9cbce605-a822-4ba4-bb1e-53ed9ec34b4c tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:44.611723 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-9cbce605-a822-4ba4-bb1e-53ed9ec34b4c tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] HTTP exception thrown: Instance 27482c04-b2af-4f4a-be37-655969d386cf could not be found. May 19 06:34:44.613419 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9cbce605-a822-4ba4-bb1e-53ed9ec34b4c tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Request method failure captured: May 19 06:34:44.613419 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf HTTP/1.1 May 19 06:34:44.613419 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept: application/json May 19 06:34:44.613419 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity May 19 06:34:44.613419 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Connection: close May 19 06:34:44.613419 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Length: 0 May 19 06:34:44.613419 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Type: application/json May 19 06:34:44.613419 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Host: 10.222.0.65 May 19 06:34:44.613419 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None May 19 06:34:44.613419 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 May 19 06:34:44.613419 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiheQpEYHNc-bqZDbTw7Fp3ihyV0ldXUTzVqdWql59X0rABgHWrMJ_mmqGdwFukt62XCeg2LJEaWYizlEXJ-MFBwGucN9hE2YUn-VSsy8oJQ2x49K6gk4QQGlP2u7BGs_KXICLfWCW8W72y7YMhrOqThFt82dOSFW0U-RORzkOxIAljYo May 19 06:34:44.613419 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Id: None May 19 06:34:44.613419 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Name: None May 19 06:34:44.613419 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed May 19 06:34:44.613419 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True May 19 06:34:44.613419 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default May 19 06:34:44.613419 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default May 19 06:34:44.613419 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Id: adbcff8654844c22a906a2e91ebca3bb May 19 06:34:44.613419 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-AttachVolumeNegativeTest-624051308 May 19 06:34:44.613419 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Role: reader,member May 19 06:34:44.613419 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Roles: reader,member May 19 06:34:44.615253 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_adbcff8654844c22a906a2e91ebca3bb", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:34:44.615253 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-AttachVolumeNegativeTest-624051308 May 19 06:34:44.615253 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Id: adbcff8654844c22a906a2e91ebca3bb May 19 06:34:44.615253 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-624051308 May 19 06:34:44.615253 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User: tempest-AttachVolumeNegativeTest-624051308-project May 19 06:34:44.615253 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default May 19 06:34:44.615253 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default May 19 06:34:44.615253 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Id: cb2bf8531dfe42b29b0b632b39d49625 May 19 06:34:44.615253 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-AttachVolumeNegativeTest-624051308-project May 19 06:34:44.615253 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: method: > May 19 06:34:44.615253 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: exception: Instance 27482c04-b2af-4f4a-be37-655969d386cf could not be found. May 19 06:34:44.615253 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: action_args: {'id': '27482c04-b2af-4f4a-be37-655969d386cf'} May 19 06:34:44.616214 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:34:44.616214 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:34:44.616214 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:34:44.616214 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:34:44.616214 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:34:44.616214 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:34:44.616214 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:34:44.616214 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:34:44.616214 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:34:44.616214 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:34:44.616214 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27482c04-b2af-4f4a-be37-655969d386cf could not be found. May 19 06:34:44.616214 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:34:44.616214 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:34:44.616214 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:34:44.616214 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:34:44.616214 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:34:44.616214 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:34:44.616214 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:34:44.616214 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:34:44.616214 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:34:44.617574 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:34:44.617574 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:34:44.617574 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:34:44.617574 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:34:44.617574 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:34:44.617574 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:34:44.617574 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:34:44.617574 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27482c04-b2af-4f4a-be37-655969d386cf could not be found. May 19 06:34:44.617574 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:34:44.617574 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:34:44.617574 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:34:44.617574 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:34:44.617574 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:34:44.617574 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:34:44.617574 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:34:44.617574 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:34:44.617574 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27482c04-b2af-4f4a-be37-655969d386cf could not be found. May 19 06:34:44.617574 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:34:44.618675 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9cbce605-a822-4ba4-bb1e-53ed9ec34b4c tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Returning 404 to user: Instance 27482c04-b2af-4f4a-be37-655969d386cf could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:34:44.618675 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9cbce605-a822-4ba4-bb1e-53ed9ec34b4c tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf" status: 404 len: 111 microversion: 2.1 time: 0.030245 May 19 06:34:44.618675 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 226/451] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:44 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:34:44.625050 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-548390bc-034f-452e-8969-d3c8f60ef93e tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '.version_select at 0x7f9aeb6dc820>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:44.644782 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-548390bc-034f-452e-8969-d3c8f60ef93e tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1268562741" status: 202 len: 0 microversion: 2.1 time: 0.024346 May 19 06:34:44.645530 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 226/452] 10.222.0.65 () {58 vars in 1220 bytes} [Thu May 19 06:34:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1268562741 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 06:34:45.321527 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2d309e90-65a0-451e-91d6-86b191a7a2aa tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Action: 'create', calling method: .version_select at 0x7f9aeac81700>, body: {"keypair": {"name": "tempest-keypair-1587867947", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExVqJrY+pQaVjzj8GLB9bP2bDumwC6aSTiS/djjl3GfZ+ULl/0twigR0j9s618k4bIX1tS95/598tqOgwWKSDdw9RAZFltv2tP7NQarL3/U5p7mtMC6A6oDXvPvo1iEdA=="}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:34:45.340801 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-2d309e90-65a0-451e-91d6-86b191a7a2aa tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Getting quotas for project adbcff8654844c22a906a2e91ebca3bb. Resources: {'key_pairs'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:34:45.346389 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-2d309e90-65a0-451e-91d6-86b191a7a2aa tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Getting quotas for user cb2bf8531dfe42b29b0b632b39d49625 and project adbcff8654844c22a906a2e91ebca3bb. Resources: {'key_pairs'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:34:45.373843 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2d309e90-65a0-451e-91d6-86b191a7a2aa tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056008 May 19 06:34:45.374925 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 227/453] 10.222.0.65 () {60 vars in 1158 bytes} [Thu May 19 06:34:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:34:46.898145 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f64ce830-2f54-45a5-85dc-b14b21fa2a8b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1583551600", "imageRef": "27959167-098e-44c5-ba0a-e9fb8054c377", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ba03612d-d3e3-499d-b899-41fd0fc8db5e"}], "security_groups": [{"name": "tempest-securitygroup--1709476611"}], "key_name": "tempest-keypair-1587867947", "user_data": "}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:34:47.014770 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.network.neutron [None req-f64ce830-2f54-45a5-85dc-b14b21fa2a8b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] validate_networks() for [('ba03612d-d3e3-499d-b899-41fd0fc8db5e', None, None, None, None, None)] {{(pid=117711) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 06:34:47.419275 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-f64ce830-2f54-45a5-85dc-b14b21fa2a8b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Flavor limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 06:34:47.420057 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-f64ce830-2f54-45a5-85dc-b14b21fa2a8b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Image limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 06:34:47.421224 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-f64ce830-2f54-45a5-85dc-b14b21fa2a8b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Flavor pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 06:34:47.421944 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-f64ce830-2f54-45a5-85dc-b14b21fa2a8b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Image pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 06:34:47.423138 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-f64ce830-2f54-45a5-85dc-b14b21fa2a8b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 06:34:47.435490 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f64ce830-2f54-45a5-85dc-b14b21fa2a8b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:47.436550 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f64ce830-2f54-45a5-85dc-b14b21fa2a8b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:47.438715 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f64ce830-2f54-45a5-85dc-b14b21fa2a8b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:47.439405 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f64ce830-2f54-45a5-85dc-b14b21fa2a8b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:47.461750 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-f64ce830-2f54-45a5-85dc-b14b21fa2a8b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Getting quotas for project adbcff8654844c22a906a2e91ebca3bb. Resources: {'ram', 'cores', 'instances'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:34:47.466046 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-f64ce830-2f54-45a5-85dc-b14b21fa2a8b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Getting quotas for user cb2bf8531dfe42b29b0b632b39d49625 and project adbcff8654844c22a906a2e91ebca3bb. Resources: {'ram', 'cores', 'instances'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:34:47.483220 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f64ce830-2f54-45a5-85dc-b14b21fa2a8b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Going to run 1 instances... {{(pid=117711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 06:34:47.486483 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f64ce830-2f54-45a5-85dc-b14b21fa2a8b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: a0707826-af06-4e43-8b88-8243dd68c7be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27959167-098e-44c5-ba0a-e9fb8054c377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 06:34:47.536351 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f64ce830-2f54-45a5-85dc-b14b21fa2a8b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.644771 May 19 06:34:47.537018 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 227/454] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 06:34:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 06:34:47.550000 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c0c98aa0-f47b-4b0e-aabd-b02cccc7adb2 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:47.550619 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c0c98aa0-f47b-4b0e-aabd-b02cccc7adb2 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: a0707826-af06-4e43-8b88-8243dd68c7be] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:47.610635 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c0c98aa0-f47b-4b0e-aabd-b02cccc7adb2 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:47.618604 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c0c98aa0-f47b-4b0e-aabd-b02cccc7adb2 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be" status: 200 len: 1242 microversion: 2.1 time: 0.074798 May 19 06:34:47.619174 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 228/455] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:47 2022] GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be => generated 1242 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:34:48.637777 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6851ab63-4606-4532-9ff3-5bb5c7ce1ef5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:48.638605 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6851ab63-4606-4532-9ff3-5bb5c7ce1ef5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: a0707826-af06-4e43-8b88-8243dd68c7be] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:48.647129 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6851ab63-4606-4532-9ff3-5bb5c7ce1ef5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:48.647574 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6851ab63-4606-4532-9ff3-5bb5c7ce1ef5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:48.648359 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6851ab63-4606-4532-9ff3-5bb5c7ce1ef5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:48.648787 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6851ab63-4606-4532-9ff3-5bb5c7ce1ef5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:48.719492 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6851ab63-4606-4532-9ff3-5bb5c7ce1ef5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:48.727800 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6851ab63-4606-4532-9ff3-5bb5c7ce1ef5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be" status: 200 len: 1246 microversion: 2.1 time: 0.094541 May 19 06:34:48.728397 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 228/456] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:48 2022] GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be => generated 1246 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:49.747109 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f12d1446-8f55-4111-be11-b350842b5417 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:49.747669 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f12d1446-8f55-4111-be11-b350842b5417 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: a0707826-af06-4e43-8b88-8243dd68c7be] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:49.754556 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f12d1446-8f55-4111-be11-b350842b5417 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:49.755016 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f12d1446-8f55-4111-be11-b350842b5417 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:49.755804 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f12d1446-8f55-4111-be11-b350842b5417 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:49.756237 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f12d1446-8f55-4111-be11-b350842b5417 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:49.822403 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f12d1446-8f55-4111-be11-b350842b5417 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:49.832554 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f12d1446-8f55-4111-be11-b350842b5417 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be" status: 200 len: 1238 microversion: 2.1 time: 0.089459 May 19 06:34:49.833142 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 229/457] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:49 2022] GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be => generated 1238 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:50.850443 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ba724a2f-4a27-4eee-a435-028a287ddc28 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:50.851103 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ba724a2f-4a27-4eee-a435-028a287ddc28 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: a0707826-af06-4e43-8b88-8243dd68c7be] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:50.858194 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ba724a2f-4a27-4eee-a435-028a287ddc28 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:50.859396 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ba724a2f-4a27-4eee-a435-028a287ddc28 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:50.860190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ba724a2f-4a27-4eee-a435-028a287ddc28 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:50.860626 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ba724a2f-4a27-4eee-a435-028a287ddc28 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:50.863502 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:34:50.977948 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ba724a2f-4a27-4eee-a435-028a287ddc28 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:50.986989 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ba724a2f-4a27-4eee-a435-028a287ddc28 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be" status: 200 len: 1302 microversion: 2.1 time: 0.140559 May 19 06:34:50.987708 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 229/458] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:50 2022] GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be => generated 1302 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:52.006721 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f72a1b85-2e15-462b-8a0d-ad3319c68ed1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:52.007960 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f72a1b85-2e15-462b-8a0d-ad3319c68ed1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: a0707826-af06-4e43-8b88-8243dd68c7be] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:52.015601 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f72a1b85-2e15-462b-8a0d-ad3319c68ed1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:52.016048 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f72a1b85-2e15-462b-8a0d-ad3319c68ed1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:52.016832 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f72a1b85-2e15-462b-8a0d-ad3319c68ed1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:52.017264 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f72a1b85-2e15-462b-8a0d-ad3319c68ed1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:52.178237 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f72a1b85-2e15-462b-8a0d-ad3319c68ed1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:52.185563 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f72a1b85-2e15-462b-8a0d-ad3319c68ed1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be" status: 200 len: 1368 microversion: 2.1 time: 0.185066 May 19 06:34:52.186836 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 230/459] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:51 2022] GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:52.508102 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-9603f843-3baf-4e50-873d-c2496b46cf70 req-3843aae7-cea8-4a57-97f1-25806af6b604 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0707826-af06-4e43-8b88-8243dd68c7be", "tag": "69e8e332-0f9f-4517-87be-fc3fabb6ba48"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:34:52.534057 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-9603f843-3baf-4e50-873d-c2496b46cf70 req-3843aae7-cea8-4a57-97f1-25806af6b604 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:52.535254 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-9603f843-3baf-4e50-873d-c2496b46cf70 req-3843aae7-cea8-4a57-97f1-25806af6b604 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:52.558380 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-9603f843-3baf-4e50-873d-c2496b46cf70 req-3843aae7-cea8-4a57-97f1-25806af6b604 service nova] Creating event network-changed:69e8e332-0f9f-4517-87be-fc3fabb6ba48 for instance a0707826-af06-4e43-8b88-8243dd68c7be on hv-cinder-83699 May 19 06:34:52.567544 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-9603f843-3baf-4e50-873d-c2496b46cf70 req-3843aae7-cea8-4a57-97f1-25806af6b604 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070785 May 19 06:34:52.568618 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 230/460] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:34:53.204177 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6d28154a-6ed6-488d-9dd5-e7e595645b69 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:53.204794 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-6d28154a-6ed6-488d-9dd5-e7e595645b69 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: a0707826-af06-4e43-8b88-8243dd68c7be] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:53.211689 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6d28154a-6ed6-488d-9dd5-e7e595645b69 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:53.212060 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6d28154a-6ed6-488d-9dd5-e7e595645b69 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:53.212868 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6d28154a-6ed6-488d-9dd5-e7e595645b69 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:53.213420 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6d28154a-6ed6-488d-9dd5-e7e595645b69 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:53.347854 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6d28154a-6ed6-488d-9dd5-e7e595645b69 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:53.355190 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6d28154a-6ed6-488d-9dd5-e7e595645b69 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be" status: 200 len: 1368 microversion: 2.1 time: 0.155077 May 19 06:34:53.355769 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 231/461] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:53 2022] GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:54.375952 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-fab996a2-044a-4295-867c-ee9cda8c57e6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:54.376744 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-fab996a2-044a-4295-867c-ee9cda8c57e6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: a0707826-af06-4e43-8b88-8243dd68c7be] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:54.384145 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fab996a2-044a-4295-867c-ee9cda8c57e6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:54.384607 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fab996a2-044a-4295-867c-ee9cda8c57e6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:54.385489 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fab996a2-044a-4295-867c-ee9cda8c57e6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:54.386112 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fab996a2-044a-4295-867c-ee9cda8c57e6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:54.621094 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-fab996a2-044a-4295-867c-ee9cda8c57e6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:54.629997 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-fab996a2-044a-4295-867c-ee9cda8c57e6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be" status: 200 len: 1368 microversion: 2.1 time: 0.259314 May 19 06:34:54.630867 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 231/462] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:54 2022] GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be => generated 1368 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:55.646985 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f913e2e9-ecaa-4a42-adae-02628c7cfe43 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:55.647497 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f913e2e9-ecaa-4a42-adae-02628c7cfe43 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: a0707826-af06-4e43-8b88-8243dd68c7be] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:55.654824 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f913e2e9-ecaa-4a42-adae-02628c7cfe43 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:55.655304 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f913e2e9-ecaa-4a42-adae-02628c7cfe43 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:55.656273 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f913e2e9-ecaa-4a42-adae-02628c7cfe43 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:55.656705 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f913e2e9-ecaa-4a42-adae-02628c7cfe43 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:55.820166 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f913e2e9-ecaa-4a42-adae-02628c7cfe43 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:55.827558 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f913e2e9-ecaa-4a42-adae-02628c7cfe43 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be" status: 200 len: 1368 microversion: 2.1 time: 0.184612 May 19 06:34:55.828280 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 232/463] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:55 2022] GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:56.845134 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ba3d140d-2e9c-4687-b4fd-6af039272d2b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:56.845811 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ba3d140d-2e9c-4687-b4fd-6af039272d2b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: a0707826-af06-4e43-8b88-8243dd68c7be] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:56.852429 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ba3d140d-2e9c-4687-b4fd-6af039272d2b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:56.852879 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ba3d140d-2e9c-4687-b4fd-6af039272d2b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:56.853690 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ba3d140d-2e9c-4687-b4fd-6af039272d2b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:56.854130 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ba3d140d-2e9c-4687-b4fd-6af039272d2b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:57.047181 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ba3d140d-2e9c-4687-b4fd-6af039272d2b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:57.055568 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ba3d140d-2e9c-4687-b4fd-6af039272d2b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be" status: 200 len: 1368 microversion: 2.1 time: 0.215301 May 19 06:34:57.056201 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 232/464] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:56 2022] GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be => generated 1368 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:57.598674 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-7173100c-95b1-48a0-811f-be5bf81263cb req-22dde366-2e27-4fb3-8243-f0142c7b579c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0707826-af06-4e43-8b88-8243dd68c7be", "name": "network-vif-plugged", "status": "completed", "tag": "69e8e332-0f9f-4517-87be-fc3fabb6ba48"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:34:57.607357 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-7173100c-95b1-48a0-811f-be5bf81263cb req-22dde366-2e27-4fb3-8243-f0142c7b579c service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:57.607784 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-7173100c-95b1-48a0-811f-be5bf81263cb req-22dde366-2e27-4fb3-8243-f0142c7b579c service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:57.618060 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=6 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:34:57.620872 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-7173100c-95b1-48a0-811f-be5bf81263cb req-22dde366-2e27-4fb3-8243-f0142c7b579c service nova] Creating event network-vif-plugged:69e8e332-0f9f-4517-87be-fc3fabb6ba48 for instance a0707826-af06-4e43-8b88-8243dd68c7be on hv-cinder-83699 May 19 06:34:57.626831 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-7173100c-95b1-48a0-811f-be5bf81263cb req-22dde366-2e27-4fb3-8243-f0142c7b579c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031977 May 19 06:34:57.627422 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 233/465] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:34:58.072930 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-db368ff7-061a-4b24-878b-d71a6eb89b5b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:58.073572 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-db368ff7-061a-4b24-878b-d71a6eb89b5b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: a0707826-af06-4e43-8b88-8243dd68c7be] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:58.075568 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:34:58.076328 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=6 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:34:58.084873 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-db368ff7-061a-4b24-878b-d71a6eb89b5b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:58.085496 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-db368ff7-061a-4b24-878b-d71a6eb89b5b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:58.086376 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-db368ff7-061a-4b24-878b-d71a6eb89b5b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:58.086914 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-db368ff7-061a-4b24-878b-d71a6eb89b5b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:58.231500 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-db368ff7-061a-4b24-878b-d71a6eb89b5b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:58.239704 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-db368ff7-061a-4b24-878b-d71a6eb89b5b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be" status: 200 len: 1368 microversion: 2.1 time: 0.170588 May 19 06:34:58.240283 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 233/466] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:58 2022] GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:59.257030 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4a6e2727-d36d-4a0e-9c59-a68698c5a40f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:59.257668 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4a6e2727-d36d-4a0e-9c59-a68698c5a40f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: a0707826-af06-4e43-8b88-8243dd68c7be] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:59.263883 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4a6e2727-d36d-4a0e-9c59-a68698c5a40f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:59.264332 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4a6e2727-d36d-4a0e-9c59-a68698c5a40f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:59.265793 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4a6e2727-d36d-4a0e-9c59-a68698c5a40f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:59.266358 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4a6e2727-d36d-4a0e-9c59-a68698c5a40f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:59.399638 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-4a6e2727-d36d-4a0e-9c59-a68698c5a40f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:34:59.407912 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4a6e2727-d36d-4a0e-9c59-a68698c5a40f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be" status: 200 len: 1368 microversion: 2.1 time: 0.155609 May 19 06:34:59.408494 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 234/467] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:34:59 2022] GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:34:59.822451 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d7819c4a-44c8-4867-8a09-6aaafe3258a7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:34:59.823016 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d7819c4a-44c8-4867-8a09-6aaafe3258a7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:34:59.830404 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d7819c4a-44c8-4867-8a09-6aaafe3258a7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:59.830844 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d7819c4a-44c8-4867-8a09-6aaafe3258a7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:59.831614 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d7819c4a-44c8-4867-8a09-6aaafe3258a7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:34:59.832045 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d7819c4a-44c8-4867-8a09-6aaafe3258a7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:34:59.962408 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-d7819c4a-44c8-4867-8a09-6aaafe3258a7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lazy-loading 'services' on Instance uuid ab7664a1-4da9-4338-996f-82bf458729ac {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:35:00.082840 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d7819c4a-44c8-4867-8a09-6aaafe3258a7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "DELETE /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac/os-volume_attachments/ad9d8385-c3e6-4e04-8459-5b1976d67663" status: 202 len: 0 microversion: 2.1 time: 0.264166 May 19 06:35:00.083357 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 234/468] 10.222.0.65 () {58 vars in 1415 bytes} [Thu May 19 06:34:59 2022] DELETE /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac/os-volume_attachments/ad9d8385-c3e6-4e04-8459-5b1976d67663 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 06:35:00.424410 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-aa275f3f-cd6b-456a-872a-4fff4821dc14 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:00.425034 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-aa275f3f-cd6b-456a-872a-4fff4821dc14 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: a0707826-af06-4e43-8b88-8243dd68c7be] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:00.431449 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-aa275f3f-cd6b-456a-872a-4fff4821dc14 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:00.431891 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-aa275f3f-cd6b-456a-872a-4fff4821dc14 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:00.432637 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-aa275f3f-cd6b-456a-872a-4fff4821dc14 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:00.433065 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-aa275f3f-cd6b-456a-872a-4fff4821dc14 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:00.561821 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-aa275f3f-cd6b-456a-872a-4fff4821dc14 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:00.569526 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-aa275f3f-cd6b-456a-872a-4fff4821dc14 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be" status: 200 len: 1558 microversion: 2.1 time: 0.149308 May 19 06:35:00.570089 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 235/469] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:00 2022] GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:00.586302 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-74b24872-03b9-48bf-8c35-56b6ae4b3992 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:00.586800 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-74b24872-03b9-48bf-8c35-56b6ae4b3992 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: a0707826-af06-4e43-8b88-8243dd68c7be] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:00.592899 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-74b24872-03b9-48bf-8c35-56b6ae4b3992 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:00.593951 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-74b24872-03b9-48bf-8c35-56b6ae4b3992 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:00.594671 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-74b24872-03b9-48bf-8c35-56b6ae4b3992 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:00.595103 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-74b24872-03b9-48bf-8c35-56b6ae4b3992 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:00.674735 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-74b24872-03b9-48bf-8c35-56b6ae4b3992 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092344 May 19 06:35:00.675516 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 235/470] 10.222.0.65 () {58 vars in 1274 bytes} [Thu May 19 06:35:00 2022] GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:35:01.204367 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-19142d67-b8f1-469e-b7b8-db95bf8e1dd2 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:35:01.210784 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-19142d67-b8f1-469e-b7b8-db95bf8e1dd2 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:01.211236 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-19142d67-b8f1-469e-b7b8-db95bf8e1dd2 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:01.235343 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-19142d67-b8f1-469e-b7b8-db95bf8e1dd2 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Going to try to stop instance {{(pid=117712) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 06:35:01.278148 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-19142d67-b8f1-469e-b7b8-db95bf8e1dd2 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "POST /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac/action" status: 202 len: 0 microversion: 2.1 time: 0.077359 May 19 06:35:01.278742 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 236/471] 10.222.0.65 () {60 vars in 1277 bytes} [Thu May 19 06:35:01 2022] POST /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 06:35:01.287180 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1faeb216-8a40-4ad0-a563-d272b9bf4495 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:01.287781 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-1faeb216-8a40-4ad0-a563-d272b9bf4495 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:01.294066 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1faeb216-8a40-4ad0-a563-d272b9bf4495 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:01.294774 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1faeb216-8a40-4ad0-a563-d272b9bf4495 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:01.295536 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1faeb216-8a40-4ad0-a563-d272b9bf4495 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:01.296125 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1faeb216-8a40-4ad0-a563-d272b9bf4495 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:01.432983 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1faeb216-8a40-4ad0-a563-d272b9bf4495 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:01.441151 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-1faeb216-8a40-4ad0-a563-d272b9bf4495 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1679 microversion: 2.1 time: 0.158191 May 19 06:35:01.441860 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 236/472] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:01 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:01.858254 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-93fe6507-3c91-4ac8-a551-1c529734d9a6 req-3c9c2508-767f-4474-86d6-ed023b24b8fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0707826-af06-4e43-8b88-8243dd68c7be", "tag": "69e8e332-0f9f-4517-87be-fc3fabb6ba48"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:35:01.866751 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-93fe6507-3c91-4ac8-a551-1c529734d9a6 req-3c9c2508-767f-4474-86d6-ed023b24b8fa service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:01.867279 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-93fe6507-3c91-4ac8-a551-1c529734d9a6 req-3c9c2508-767f-4474-86d6-ed023b24b8fa service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:01.879520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-93fe6507-3c91-4ac8-a551-1c529734d9a6 req-3c9c2508-767f-4474-86d6-ed023b24b8fa service nova] Creating event network-changed:69e8e332-0f9f-4517-87be-fc3fabb6ba48 for instance a0707826-af06-4e43-8b88-8243dd68c7be on hv-cinder-83699 May 19 06:35:01.884770 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-93fe6507-3c91-4ac8-a551-1c529734d9a6 req-3c9c2508-767f-4474-86d6-ed023b24b8fa service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031642 May 19 06:35:01.885797 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 237/473] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:35:02.458641 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e02c98cd-c6c8-432f-b4f7-ee00e39212ca tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:02.459313 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e02c98cd-c6c8-432f-b4f7-ee00e39212ca tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:02.465898 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e02c98cd-c6c8-432f-b4f7-ee00e39212ca tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:02.466343 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e02c98cd-c6c8-432f-b4f7-ee00e39212ca tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:02.467106 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e02c98cd-c6c8-432f-b4f7-ee00e39212ca tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:02.467537 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e02c98cd-c6c8-432f-b4f7-ee00e39212ca tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:02.605799 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e02c98cd-c6c8-432f-b4f7-ee00e39212ca tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:02.614035 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e02c98cd-c6c8-432f-b4f7-ee00e39212ca tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1679 microversion: 2.1 time: 0.159212 May 19 06:35:02.614615 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 237/474] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:02 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:03.631929 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d65e30e3-c494-43a0-9c6a-4846a8073280 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:03.632623 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d65e30e3-c494-43a0-9c6a-4846a8073280 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:03.639472 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d65e30e3-c494-43a0-9c6a-4846a8073280 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:03.640492 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d65e30e3-c494-43a0-9c6a-4846a8073280 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:03.641620 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d65e30e3-c494-43a0-9c6a-4846a8073280 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:03.642058 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d65e30e3-c494-43a0-9c6a-4846a8073280 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:03.775662 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d65e30e3-c494-43a0-9c6a-4846a8073280 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:03.784313 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d65e30e3-c494-43a0-9c6a-4846a8073280 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1679 microversion: 2.1 time: 0.156494 May 19 06:35:03.784891 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 238/475] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:03 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:35:04.802011 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-94989584-fd62-4e99-ac84-b0d7a8403895 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:04.802656 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-94989584-fd62-4e99-ac84-b0d7a8403895 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:04.805454 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:35:04.811120 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-94989584-fd62-4e99-ac84-b0d7a8403895 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:04.811569 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-94989584-fd62-4e99-ac84-b0d7a8403895 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:04.812340 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-94989584-fd62-4e99-ac84-b0d7a8403895 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:04.812772 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-94989584-fd62-4e99-ac84-b0d7a8403895 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:04.966325 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-94989584-fd62-4e99-ac84-b0d7a8403895 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:04.976391 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-94989584-fd62-4e99-ac84-b0d7a8403895 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1679 microversion: 2.1 time: 0.178099 May 19 06:35:04.980540 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 238/476] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:04 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:05.994833 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-773a63e1-1b48-4f4f-be8f-a7bf3246233b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:05.995430 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-773a63e1-1b48-4f4f-be8f-a7bf3246233b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:06.002570 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-773a63e1-1b48-4f4f-be8f-a7bf3246233b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:06.003423 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-773a63e1-1b48-4f4f-be8f-a7bf3246233b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:06.004194 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-773a63e1-1b48-4f4f-be8f-a7bf3246233b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:06.004624 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-773a63e1-1b48-4f4f-be8f-a7bf3246233b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:06.147319 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-773a63e1-1b48-4f4f-be8f-a7bf3246233b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:06.155226 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-773a63e1-1b48-4f4f-be8f-a7bf3246233b tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1679 microversion: 2.1 time: 0.164289 May 19 06:35:06.155840 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 239/477] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:05 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:07.072922 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-cca94ab0-f8d8-4a83-98b6-4da0008385b9 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc901c90-4dfe-43fb-b856-e29064abd557"}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:35:07.074080 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-cca94ab0-f8d8-4a83-98b6-4da0008385b9 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:07.080992 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cca94ab0-f8d8-4a83-98b6-4da0008385b9 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:07.081464 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cca94ab0-f8d8-4a83-98b6-4da0008385b9 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:07.082220 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cca94ab0-f8d8-4a83-98b6-4da0008385b9 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:07.082657 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cca94ab0-f8d8-4a83-98b6-4da0008385b9 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:07.172305 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0cc2947f-1916-48a3-9f64-69561a3932ea tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:07.172911 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0cc2947f-1916-48a3-9f64-69561a3932ea tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:07.179373 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0cc2947f-1916-48a3-9f64-69561a3932ea tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:07.179821 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0cc2947f-1916-48a3-9f64-69561a3932ea tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:07.180599 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0cc2947f-1916-48a3-9f64-69561a3932ea tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:07.181124 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0cc2947f-1916-48a3-9f64-69561a3932ea tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:07.199831 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:35:07.325457 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0cc2947f-1916-48a3-9f64-69561a3932ea tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:07.333891 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0cc2947f-1916-48a3-9f64-69561a3932ea tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1679 microversion: 2.1 time: 0.165475 May 19 06:35:07.336719 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-cca94ab0-f8d8-4a83-98b6-4da0008385b9 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "POST /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267049 May 19 06:35:07.337582 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 239/478] 10.222.0.65 () {60 vars in 1322 bytes} [Thu May 19 06:35:07 2022] POST /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:35:07.350012 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 240/479] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:07 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:35:08.352516 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a7aa83fa-2969-4695-99f8-525ec010c5f9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:08.353243 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a7aa83fa-2969-4695-99f8-525ec010c5f9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:08.359506 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a7aa83fa-2969-4695-99f8-525ec010c5f9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:08.359957 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a7aa83fa-2969-4695-99f8-525ec010c5f9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:08.360753 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a7aa83fa-2969-4695-99f8-525ec010c5f9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:08.361186 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a7aa83fa-2969-4695-99f8-525ec010c5f9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:08.496357 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a7aa83fa-2969-4695-99f8-525ec010c5f9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:08.504339 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a7aa83fa-2969-4695-99f8-525ec010c5f9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1679 microversion: 2.1 time: 0.156649 May 19 06:35:08.504901 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 240/480] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:08 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:09.521109 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6c9da475-c952-43e2-a82c-803aeec16dc7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:09.521738 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-6c9da475-c952-43e2-a82c-803aeec16dc7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:09.528523 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6c9da475-c952-43e2-a82c-803aeec16dc7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:09.528964 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6c9da475-c952-43e2-a82c-803aeec16dc7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:09.529745 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6c9da475-c952-43e2-a82c-803aeec16dc7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:09.530170 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6c9da475-c952-43e2-a82c-803aeec16dc7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:09.661842 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6c9da475-c952-43e2-a82c-803aeec16dc7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:09.669186 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6c9da475-c952-43e2-a82c-803aeec16dc7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1679 microversion: 2.1 time: 0.151916 May 19 06:35:09.669777 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 241/481] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:09 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:10.686225 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f35cce7b-fd9d-44fd-babc-4b4f2f5c6126 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:10.686833 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f35cce7b-fd9d-44fd-babc-4b4f2f5c6126 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:10.694173 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f35cce7b-fd9d-44fd-babc-4b4f2f5c6126 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:10.694625 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f35cce7b-fd9d-44fd-babc-4b4f2f5c6126 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:10.695388 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f35cce7b-fd9d-44fd-babc-4b4f2f5c6126 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:10.695822 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f35cce7b-fd9d-44fd-babc-4b4f2f5c6126 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:10.825238 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f35cce7b-fd9d-44fd-babc-4b4f2f5c6126 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:10.832811 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f35cce7b-fd9d-44fd-babc-4b4f2f5c6126 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1679 microversion: 2.1 time: 0.150445 May 19 06:35:10.833401 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 241/482] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:10 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:11.850212 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-33f2df65-eb0b-400d-930d-e795b5d3a23a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:11.850735 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-33f2df65-eb0b-400d-930d-e795b5d3a23a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:11.857363 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-33f2df65-eb0b-400d-930d-e795b5d3a23a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:11.857821 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-33f2df65-eb0b-400d-930d-e795b5d3a23a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:11.858573 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-33f2df65-eb0b-400d-930d-e795b5d3a23a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:11.859006 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-33f2df65-eb0b-400d-930d-e795b5d3a23a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:11.995355 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-33f2df65-eb0b-400d-930d-e795b5d3a23a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:12.003659 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-33f2df65-eb0b-400d-930d-e795b5d3a23a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1656 microversion: 2.1 time: 0.157501 May 19 06:35:12.004235 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 242/483] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:11 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1656 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:12.020046 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-53f89165-0a47-4ffc-bbca-bdc44c80634f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:35:12.026660 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-53f89165-0a47-4ffc-bbca-bdc44c80634f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:12.027108 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-53f89165-0a47-4ffc-bbca-bdc44c80634f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:12.060045 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-53f89165-0a47-4ffc-bbca-bdc44c80634f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Going to try to start instance {{(pid=117711) start /opt/stack/nova/nova/compute/api.py:2730}} May 19 06:35:12.104054 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-53f89165-0a47-4ffc-bbca-bdc44c80634f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "POST /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac/action" status: 202 len: 0 microversion: 2.1 time: 0.087646 May 19 06:35:12.104594 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 242/484] 10.222.0.65 () {60 vars in 1277 bytes} [Thu May 19 06:35:12 2022] POST /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 06:35:12.113641 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4e2ae861-ad79-4dfc-a942-a1c1476f9a3f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:12.114360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4e2ae861-ad79-4dfc-a942-a1c1476f9a3f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:12.120578 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4e2ae861-ad79-4dfc-a942-a1c1476f9a3f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:12.120953 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4e2ae861-ad79-4dfc-a942-a1c1476f9a3f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:12.121784 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4e2ae861-ad79-4dfc-a942-a1c1476f9a3f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:12.122218 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4e2ae861-ad79-4dfc-a942-a1c1476f9a3f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:12.273134 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-4e2ae861-ad79-4dfc-a942-a1c1476f9a3f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:12.282726 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4e2ae861-ad79-4dfc-a942-a1c1476f9a3f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1665 microversion: 2.1 time: 0.173397 May 19 06:35:12.283649 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 243/485] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:12 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1665 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:35:13.301260 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-da74c045-b286-4e7e-bed7-b5042b10c500 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:13.301893 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-da74c045-b286-4e7e-bed7-b5042b10c500 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:13.308000 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-da74c045-b286-4e7e-bed7-b5042b10c500 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:13.308439 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-da74c045-b286-4e7e-bed7-b5042b10c500 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:13.309218 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-da74c045-b286-4e7e-bed7-b5042b10c500 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:13.309669 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-da74c045-b286-4e7e-bed7-b5042b10c500 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:13.454980 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-da74c045-b286-4e7e-bed7-b5042b10c500 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:13.457302 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:35:13.463762 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-da74c045-b286-4e7e-bed7-b5042b10c500 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1665 microversion: 2.1 time: 0.167355 May 19 06:35:13.464332 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 243/486] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:13 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1665 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:14.065068 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c436ccf9-e0c7-4b3e-aec6-653cd33b24d5 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:35:14.066139 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c436ccf9-e0c7-4b3e-aec6-653cd33b24d5 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:14.067980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:35:14.073102 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c436ccf9-e0c7-4b3e-aec6-653cd33b24d5 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:14.073580 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c436ccf9-e0c7-4b3e-aec6-653cd33b24d5 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:14.074339 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c436ccf9-e0c7-4b3e-aec6-653cd33b24d5 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:14.074810 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c436ccf9-e0c7-4b3e-aec6-653cd33b24d5 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:14.149912 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c436ccf9-e0c7-4b3e-aec6-653cd33b24d5 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "POST /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a/action" status: 202 len: 0 microversion: 2.1 time: 0.088676 May 19 06:35:14.150557 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 244/487] 10.222.0.65 () {60 vars in 1277 bytes} [Thu May 19 06:35:14 2022] POST /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 06:35:14.160319 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d9439ad4-af15-4043-9aed-679732930320 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:14.161166 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d9439ad4-af15-4043-9aed-679732930320 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:14.168476 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d9439ad4-af15-4043-9aed-679732930320 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:14.168987 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d9439ad4-af15-4043-9aed-679732930320 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:14.169861 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d9439ad4-af15-4043-9aed-679732930320 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:14.170350 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d9439ad4-af15-4043-9aed-679732930320 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:14.369455 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d9439ad4-af15-4043-9aed-679732930320 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:14.377639 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d9439ad4-af15-4043-9aed-679732930320 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1750 microversion: 2.1 time: 0.222106 May 19 06:35:14.378223 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 244/488] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:14 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1750 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:14.481330 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e66320b4-63fc-4dd6-96db-126011700e31 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:14.482032 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e66320b4-63fc-4dd6-96db-126011700e31 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:14.488350 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e66320b4-63fc-4dd6-96db-126011700e31 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:14.488801 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e66320b4-63fc-4dd6-96db-126011700e31 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:14.489590 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e66320b4-63fc-4dd6-96db-126011700e31 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:14.490027 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e66320b4-63fc-4dd6-96db-126011700e31 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:14.626427 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e66320b4-63fc-4dd6-96db-126011700e31 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:14.634032 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e66320b4-63fc-4dd6-96db-126011700e31 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1669 microversion: 2.1 time: 0.156980 May 19 06:35:14.634798 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 245/489] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:14 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:14.862149 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f7ee108d-030f-4c8d-9e3a-d4164bf3c1cc tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:35:14.863161 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f7ee108d-030f-4c8d-9e3a-d4164bf3c1cc tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:14.869096 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f7ee108d-030f-4c8d-9e3a-d4164bf3c1cc tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:14.869560 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f7ee108d-030f-4c8d-9e3a-d4164bf3c1cc tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:14.870362 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f7ee108d-030f-4c8d-9e3a-d4164bf3c1cc tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:14.870736 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f7ee108d-030f-4c8d-9e3a-d4164bf3c1cc tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:14.893449 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-f7ee108d-030f-4c8d-9e3a-d4164bf3c1cc tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lazy-loading 'flavor' on Instance uuid 3e905065-4c72-403f-ba1f-3d56ec56b4f0 {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:35:15.057239 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f7ee108d-030f-4c8d-9e3a-d4164bf3c1cc tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "POST /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0/action" status: 200 len: 32 microversion: 2.1 time: 0.198987 May 19 06:35:15.057888 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 245/490] 10.222.0.65 () {60 vars in 1277 bytes} [Thu May 19 06:35:14 2022] POST /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0/action => generated 32 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 06:35:15.072081 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-76bcc8a6-e3f3-4ae9-a7f4-f18cd7a2bfbe tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:15.072970 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-76bcc8a6-e3f3-4ae9-a7f4-f18cd7a2bfbe tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:15.080906 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-76bcc8a6-e3f3-4ae9-a7f4-f18cd7a2bfbe tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:15.081395 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-76bcc8a6-e3f3-4ae9-a7f4-f18cd7a2bfbe tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:15.082177 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-76bcc8a6-e3f3-4ae9-a7f4-f18cd7a2bfbe tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:15.082608 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-76bcc8a6-e3f3-4ae9-a7f4-f18cd7a2bfbe tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:15.220362 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-76bcc8a6-e3f3-4ae9-a7f4-f18cd7a2bfbe tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:15.228559 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-76bcc8a6-e3f3-4ae9-a7f4-f18cd7a2bfbe tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1733 microversion: 2.1 time: 0.164145 May 19 06:35:15.229418 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 246/491] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:15 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:35:15.397322 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5ad8b579-70dd-4a8b-88ca-40a8ea33d24a tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:15.398025 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5ad8b579-70dd-4a8b-88ca-40a8ea33d24a tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:15.404828 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5ad8b579-70dd-4a8b-88ca-40a8ea33d24a tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:15.405356 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5ad8b579-70dd-4a8b-88ca-40a8ea33d24a tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:15.406876 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5ad8b579-70dd-4a8b-88ca-40a8ea33d24a tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:15.407325 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5ad8b579-70dd-4a8b-88ca-40a8ea33d24a tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:15.657941 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5ad8b579-70dd-4a8b-88ca-40a8ea33d24a tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:15.669679 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5ad8b579-70dd-4a8b-88ca-40a8ea33d24a tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1755 microversion: 2.1 time: 0.277240 May 19 06:35:15.670806 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 246/492] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:15 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1755 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:16.247410 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9ae68277-396c-4a97-b886-df7e3399f30a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:16.248011 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9ae68277-396c-4a97-b886-df7e3399f30a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:16.255668 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9ae68277-396c-4a97-b886-df7e3399f30a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:16.256116 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9ae68277-396c-4a97-b886-df7e3399f30a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:16.256891 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9ae68277-396c-4a97-b886-df7e3399f30a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:16.257354 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9ae68277-396c-4a97-b886-df7e3399f30a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:16.392318 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9ae68277-396c-4a97-b886-df7e3399f30a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:16.400206 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9ae68277-396c-4a97-b886-df7e3399f30a tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1733 microversion: 2.1 time: 0.156792 May 19 06:35:16.400769 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 247/493] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:16 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:16.690856 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5527ba00-d54a-41b4-b638-3bf62c8cd872 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:16.691465 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5527ba00-d54a-41b4-b638-3bf62c8cd872 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:16.697425 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5527ba00-d54a-41b4-b638-3bf62c8cd872 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:16.697867 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5527ba00-d54a-41b4-b638-3bf62c8cd872 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:16.698614 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5527ba00-d54a-41b4-b638-3bf62c8cd872 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:16.699041 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5527ba00-d54a-41b4-b638-3bf62c8cd872 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:16.842498 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5527ba00-d54a-41b4-b638-3bf62c8cd872 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:16.850825 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5527ba00-d54a-41b4-b638-3bf62c8cd872 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1755 microversion: 2.1 time: 0.166741 May 19 06:35:16.851389 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 247/494] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:16 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:17.418544 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a12c1201-2fec-4d04-b5ad-b07636b7bcb5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:17.419193 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a12c1201-2fec-4d04-b5ad-b07636b7bcb5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:17.426242 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a12c1201-2fec-4d04-b5ad-b07636b7bcb5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:17.426697 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a12c1201-2fec-4d04-b5ad-b07636b7bcb5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:17.428212 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a12c1201-2fec-4d04-b5ad-b07636b7bcb5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:17.428858 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a12c1201-2fec-4d04-b5ad-b07636b7bcb5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:17.558836 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a12c1201-2fec-4d04-b5ad-b07636b7bcb5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:17.567350 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a12c1201-2fec-4d04-b5ad-b07636b7bcb5 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1733 microversion: 2.1 time: 0.152866 May 19 06:35:17.567915 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 248/495] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:17 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:35:17.868633 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7ed68af7-342f-4b6b-8e0e-7978cde404b8 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:17.869399 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7ed68af7-342f-4b6b-8e0e-7978cde404b8 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:17.877128 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7ed68af7-342f-4b6b-8e0e-7978cde404b8 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:17.877596 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7ed68af7-342f-4b6b-8e0e-7978cde404b8 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:17.878375 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7ed68af7-342f-4b6b-8e0e-7978cde404b8 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:17.878803 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7ed68af7-342f-4b6b-8e0e-7978cde404b8 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:18.025100 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7ed68af7-342f-4b6b-8e0e-7978cde404b8 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:18.034680 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7ed68af7-342f-4b6b-8e0e-7978cde404b8 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1755 microversion: 2.1 time: 0.170027 May 19 06:35:18.035660 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 248/496] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:17 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:18.586413 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-bdc0af7a-d6ab-4d23-99fc-1f3d3f241369 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:18.586974 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-bdc0af7a-d6ab-4d23-99fc-1f3d3f241369 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:18.596089 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bdc0af7a-d6ab-4d23-99fc-1f3d3f241369 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:18.597321 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bdc0af7a-d6ab-4d23-99fc-1f3d3f241369 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:18.598162 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bdc0af7a-d6ab-4d23-99fc-1f3d3f241369 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:18.598700 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bdc0af7a-d6ab-4d23-99fc-1f3d3f241369 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:18.755962 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-bdc0af7a-d6ab-4d23-99fc-1f3d3f241369 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:18.767939 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-bdc0af7a-d6ab-4d23-99fc-1f3d3f241369 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1733 microversion: 2.1 time: 0.186541 May 19 06:35:18.767939 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 249/497] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:18 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1733 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:19.052708 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a2960de1-14d4-494f-bf98-7e4f709a03ea tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:19.053340 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a2960de1-14d4-494f-bf98-7e4f709a03ea tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:19.060668 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a2960de1-14d4-494f-bf98-7e4f709a03ea tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:19.061112 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a2960de1-14d4-494f-bf98-7e4f709a03ea tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:19.062385 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a2960de1-14d4-494f-bf98-7e4f709a03ea tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:19.062826 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a2960de1-14d4-494f-bf98-7e4f709a03ea tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:19.211896 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a2960de1-14d4-494f-bf98-7e4f709a03ea tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:19.220551 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a2960de1-14d4-494f-bf98-7e4f709a03ea tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1755 microversion: 2.1 time: 0.171717 May 19 06:35:19.221129 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 249/498] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:19 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:19.786057 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1ac3a547-c297-4cd5-af44-5f5633171e41 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:19.786676 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1ac3a547-c297-4cd5-af44-5f5633171e41 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:19.795468 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1ac3a547-c297-4cd5-af44-5f5633171e41 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:19.795468 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1ac3a547-c297-4cd5-af44-5f5633171e41 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:19.795468 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1ac3a547-c297-4cd5-af44-5f5633171e41 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:19.795468 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1ac3a547-c297-4cd5-af44-5f5633171e41 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:19.936181 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1ac3a547-c297-4cd5-af44-5f5633171e41 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:19.945266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1ac3a547-c297-4cd5-af44-5f5633171e41 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1733 microversion: 2.1 time: 0.163069 May 19 06:35:19.945873 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 250/499] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:19 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:20.239094 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f36af001-0e61-48ba-8906-1090eec97be7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:20.239712 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f36af001-0e61-48ba-8906-1090eec97be7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:20.246698 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f36af001-0e61-48ba-8906-1090eec97be7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:20.247240 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f36af001-0e61-48ba-8906-1090eec97be7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:20.248028 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f36af001-0e61-48ba-8906-1090eec97be7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:20.248462 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f36af001-0e61-48ba-8906-1090eec97be7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:20.406920 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f36af001-0e61-48ba-8906-1090eec97be7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:20.415142 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f36af001-0e61-48ba-8906-1090eec97be7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1755 microversion: 2.1 time: 0.180955 May 19 06:35:20.415742 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 250/500] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:20 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:20.963968 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-95a41834-dca7-46f6-9fea-3fdcda98ecd8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:20.964620 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-95a41834-dca7-46f6-9fea-3fdcda98ecd8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:20.971762 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-95a41834-dca7-46f6-9fea-3fdcda98ecd8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:20.972211 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-95a41834-dca7-46f6-9fea-3fdcda98ecd8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:20.972993 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-95a41834-dca7-46f6-9fea-3fdcda98ecd8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:20.973470 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-95a41834-dca7-46f6-9fea-3fdcda98ecd8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:21.122145 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-95a41834-dca7-46f6-9fea-3fdcda98ecd8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:21.130830 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-95a41834-dca7-46f6-9fea-3fdcda98ecd8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1733 microversion: 2.1 time: 0.170832 May 19 06:35:21.131407 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 251/501] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:20 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1733 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:35:21.433551 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-258be9c2-e3c4-4c22-bb64-dfa80344d5ab tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:21.434176 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-258be9c2-e3c4-4c22-bb64-dfa80344d5ab tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:21.440810 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-258be9c2-e3c4-4c22-bb64-dfa80344d5ab tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:21.441257 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-258be9c2-e3c4-4c22-bb64-dfa80344d5ab tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:21.442054 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-258be9c2-e3c4-4c22-bb64-dfa80344d5ab tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:21.442487 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-258be9c2-e3c4-4c22-bb64-dfa80344d5ab tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:21.604201 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-258be9c2-e3c4-4c22-bb64-dfa80344d5ab tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:21.614097 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-258be9c2-e3c4-4c22-bb64-dfa80344d5ab tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1755 microversion: 2.1 time: 0.184643 May 19 06:35:21.614682 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 251/502] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:21 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:22.148847 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0dd66268-90a7-4038-a381-192b7fbc0271 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:22.149540 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0dd66268-90a7-4038-a381-192b7fbc0271 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:22.157819 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0dd66268-90a7-4038-a381-192b7fbc0271 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:22.158277 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0dd66268-90a7-4038-a381-192b7fbc0271 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:22.159082 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0dd66268-90a7-4038-a381-192b7fbc0271 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:22.159615 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0dd66268-90a7-4038-a381-192b7fbc0271 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:22.308058 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0dd66268-90a7-4038-a381-192b7fbc0271 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:22.317031 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0dd66268-90a7-4038-a381-192b7fbc0271 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1733 microversion: 2.1 time: 0.172280 May 19 06:35:22.319942 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 252/503] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:22 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:22.631227 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d7bfc787-6903-4114-8696-13f812c7d9e2 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:22.631927 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d7bfc787-6903-4114-8696-13f812c7d9e2 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:22.638850 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d7bfc787-6903-4114-8696-13f812c7d9e2 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:22.639298 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d7bfc787-6903-4114-8696-13f812c7d9e2 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:22.640641 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d7bfc787-6903-4114-8696-13f812c7d9e2 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:22.641090 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d7bfc787-6903-4114-8696-13f812c7d9e2 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:22.809319 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d7bfc787-6903-4114-8696-13f812c7d9e2 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:22.818020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d7bfc787-6903-4114-8696-13f812c7d9e2 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1755 microversion: 2.1 time: 0.190647 May 19 06:35:22.818585 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 252/504] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:22 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:35:23.338263 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c99b4608-f150-43a3-b80c-20a4788b4c6e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:23.339055 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c99b4608-f150-43a3-b80c-20a4788b4c6e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:23.347436 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c99b4608-f150-43a3-b80c-20a4788b4c6e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:23.348083 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c99b4608-f150-43a3-b80c-20a4788b4c6e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:23.349259 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c99b4608-f150-43a3-b80c-20a4788b4c6e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:23.350039 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c99b4608-f150-43a3-b80c-20a4788b4c6e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:23.507513 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c99b4608-f150-43a3-b80c-20a4788b4c6e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:23.520623 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c99b4608-f150-43a3-b80c-20a4788b4c6e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1733 microversion: 2.1 time: 0.186938 May 19 06:35:23.521215 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 253/505] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:23 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1733 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:23.835757 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-9b5c2d63-902e-4c72-8060-dee7aa068ae7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:23.836443 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-9b5c2d63-902e-4c72-8060-dee7aa068ae7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:23.843570 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9b5c2d63-902e-4c72-8060-dee7aa068ae7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:23.844149 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9b5c2d63-902e-4c72-8060-dee7aa068ae7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:23.844985 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9b5c2d63-902e-4c72-8060-dee7aa068ae7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:23.845520 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9b5c2d63-902e-4c72-8060-dee7aa068ae7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:24.004796 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9b5c2d63-902e-4c72-8060-dee7aa068ae7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:24.021341 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-9b5c2d63-902e-4c72-8060-dee7aa068ae7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1755 microversion: 2.1 time: 0.189070 May 19 06:35:24.022404 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 253/506] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:23 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1755 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:24.538167 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7a16a416-5fbe-4f91-b0c3-b7fbf961c810 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:24.539168 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7a16a416-5fbe-4f91-b0c3-b7fbf961c810 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:24.546288 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7a16a416-5fbe-4f91-b0c3-b7fbf961c810 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:24.547217 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7a16a416-5fbe-4f91-b0c3-b7fbf961c810 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:24.547908 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7a16a416-5fbe-4f91-b0c3-b7fbf961c810 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:24.548410 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7a16a416-5fbe-4f91-b0c3-b7fbf961c810 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:24.705310 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7a16a416-5fbe-4f91-b0c3-b7fbf961c810 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:24.713686 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7a16a416-5fbe-4f91-b0c3-b7fbf961c810 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1733 microversion: 2.1 time: 0.179521 May 19 06:35:24.714292 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 254/507] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:24 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1733 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:25.040288 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a86d731f-3ce0-481e-bcf7-af766e12a79f tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:25.041104 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a86d731f-3ce0-481e-bcf7-af766e12a79f tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:25.048254 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a86d731f-3ce0-481e-bcf7-af766e12a79f tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:25.048704 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a86d731f-3ce0-481e-bcf7-af766e12a79f tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:25.049520 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a86d731f-3ce0-481e-bcf7-af766e12a79f tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:25.049958 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a86d731f-3ce0-481e-bcf7-af766e12a79f tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:25.200347 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a86d731f-3ce0-481e-bcf7-af766e12a79f tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:25.209505 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a86d731f-3ce0-481e-bcf7-af766e12a79f tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1755 microversion: 2.1 time: 0.173391 May 19 06:35:25.210094 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 254/508] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:25 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:25.732402 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4945c7d7-2e96-4ae4-926c-302937dc46b4 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:25.733013 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4945c7d7-2e96-4ae4-926c-302937dc46b4 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:25.740317 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4945c7d7-2e96-4ae4-926c-302937dc46b4 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:25.740759 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4945c7d7-2e96-4ae4-926c-302937dc46b4 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:25.741615 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4945c7d7-2e96-4ae4-926c-302937dc46b4 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:25.742043 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4945c7d7-2e96-4ae4-926c-302937dc46b4 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:25.925274 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-4945c7d7-2e96-4ae4-926c-302937dc46b4 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:25.933692 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4945c7d7-2e96-4ae4-926c-302937dc46b4 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1733 microversion: 2.1 time: 0.205460 May 19 06:35:25.934279 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 255/509] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:25 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1733 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:26.226804 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-209ddd7e-ea52-4410-8785-8a11b94a4f6c tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:26.227399 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-209ddd7e-ea52-4410-8785-8a11b94a4f6c tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:26.234746 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-209ddd7e-ea52-4410-8785-8a11b94a4f6c tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:26.235189 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-209ddd7e-ea52-4410-8785-8a11b94a4f6c tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:26.235960 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-209ddd7e-ea52-4410-8785-8a11b94a4f6c tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:26.236389 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-209ddd7e-ea52-4410-8785-8a11b94a4f6c tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:26.391659 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-209ddd7e-ea52-4410-8785-8a11b94a4f6c tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:26.400467 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-209ddd7e-ea52-4410-8785-8a11b94a4f6c tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1755 microversion: 2.1 time: 0.177430 May 19 06:35:26.401153 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 255/510] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:26 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:26.955637 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a45e5725-6c7e-4fb6-a266-b4859fce22ba tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:26.956282 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a45e5725-6c7e-4fb6-a266-b4859fce22ba tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:26.963466 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a45e5725-6c7e-4fb6-a266-b4859fce22ba tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:26.963910 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a45e5725-6c7e-4fb6-a266-b4859fce22ba tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:26.964693 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a45e5725-6c7e-4fb6-a266-b4859fce22ba tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:26.965120 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a45e5725-6c7e-4fb6-a266-b4859fce22ba tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:26.968871 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:35:27.120928 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a45e5725-6c7e-4fb6-a266-b4859fce22ba tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:27.129130 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a45e5725-6c7e-4fb6-a266-b4859fce22ba tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1733 microversion: 2.1 time: 0.179725 May 19 06:35:27.129738 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 256/511] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:26 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1733 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:27.420069 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-76c9ba82-50a9-47ea-bb87-0aa502fb5dfd tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:27.420652 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-76c9ba82-50a9-47ea-bb87-0aa502fb5dfd tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:27.427747 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-76c9ba82-50a9-47ea-bb87-0aa502fb5dfd tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:27.428190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-76c9ba82-50a9-47ea-bb87-0aa502fb5dfd tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:27.428969 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-76c9ba82-50a9-47ea-bb87-0aa502fb5dfd tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:27.429433 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-76c9ba82-50a9-47ea-bb87-0aa502fb5dfd tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:27.605318 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-76c9ba82-50a9-47ea-bb87-0aa502fb5dfd tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:27.614227 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-76c9ba82-50a9-47ea-bb87-0aa502fb5dfd tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1755 microversion: 2.1 time: 0.198005 May 19 06:35:27.614814 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 256/512] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:27 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1755 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:28.148366 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ad20d8f4-851f-4878-a153-27fac198cb89 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:28.149130 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ad20d8f4-851f-4878-a153-27fac198cb89 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:28.157027 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ad20d8f4-851f-4878-a153-27fac198cb89 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:28.157507 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ad20d8f4-851f-4878-a153-27fac198cb89 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:28.158274 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ad20d8f4-851f-4878-a153-27fac198cb89 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:28.158700 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ad20d8f4-851f-4878-a153-27fac198cb89 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:28.301540 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ad20d8f4-851f-4878-a153-27fac198cb89 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:28.309691 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ad20d8f4-851f-4878-a153-27fac198cb89 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1733 microversion: 2.1 time: 0.165765 May 19 06:35:28.310274 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 257/513] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:28 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:28.631853 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c9e455ce-555d-41d9-a840-668253b5c8fd tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:28.632690 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c9e455ce-555d-41d9-a840-668253b5c8fd tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:28.640759 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c9e455ce-555d-41d9-a840-668253b5c8fd tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:28.641832 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c9e455ce-555d-41d9-a840-668253b5c8fd tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:28.643089 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c9e455ce-555d-41d9-a840-668253b5c8fd tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:28.643298 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c9e455ce-555d-41d9-a840-668253b5c8fd tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:28.814353 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c9e455ce-555d-41d9-a840-668253b5c8fd tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:28.822893 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c9e455ce-555d-41d9-a840-668253b5c8fd tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1755 microversion: 2.1 time: 0.194909 May 19 06:35:28.823482 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 257/514] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:28 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1755 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:29.328683 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-aa936e5b-4c0f-4f15-bab7-5f6b5e07fb7e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:29.329385 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-aa936e5b-4c0f-4f15-bab7-5f6b5e07fb7e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:29.336552 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-aa936e5b-4c0f-4f15-bab7-5f6b5e07fb7e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:29.336991 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-aa936e5b-4c0f-4f15-bab7-5f6b5e07fb7e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:29.337811 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-aa936e5b-4c0f-4f15-bab7-5f6b5e07fb7e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:29.338237 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-aa936e5b-4c0f-4f15-bab7-5f6b5e07fb7e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:29.476045 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-aa936e5b-4c0f-4f15-bab7-5f6b5e07fb7e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:29.484484 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-aa936e5b-4c0f-4f15-bab7-5f6b5e07fb7e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1733 microversion: 2.1 time: 0.160580 May 19 06:35:29.485079 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 258/515] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:29 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:29.841532 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6064f23d-b00a-47e3-9345-89ec601532c3 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:29.842051 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6064f23d-b00a-47e3-9345-89ec601532c3 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:29.848874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6064f23d-b00a-47e3-9345-89ec601532c3 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:29.849343 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6064f23d-b00a-47e3-9345-89ec601532c3 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:29.850133 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6064f23d-b00a-47e3-9345-89ec601532c3 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:29.850596 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6064f23d-b00a-47e3-9345-89ec601532c3 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:29.866724 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:35:30.006830 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6064f23d-b00a-47e3-9345-89ec601532c3 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:30.015190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6064f23d-b00a-47e3-9345-89ec601532c3 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1755 microversion: 2.1 time: 0.177616 May 19 06:35:30.015757 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 258/516] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:29 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:30.502887 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-57944246-fa6d-4f04-9000-c89cfe0e5901 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:30.503488 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-57944246-fa6d-4f04-9000-c89cfe0e5901 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:30.511443 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-57944246-fa6d-4f04-9000-c89cfe0e5901 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:30.512048 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-57944246-fa6d-4f04-9000-c89cfe0e5901 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:30.512998 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-57944246-fa6d-4f04-9000-c89cfe0e5901 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:30.513631 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-57944246-fa6d-4f04-9000-c89cfe0e5901 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:30.661036 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-57944246-fa6d-4f04-9000-c89cfe0e5901 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:30.672753 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-57944246-fa6d-4f04-9000-c89cfe0e5901 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1733 microversion: 2.1 time: 0.173861 May 19 06:35:30.673364 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 259/517] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:30 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1733 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:35:31.033096 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-2eec8718-2a55-4c46-aab1-70b5bfd802b9 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:31.033715 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-2eec8718-2a55-4c46-aab1-70b5bfd802b9 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:31.041101 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2eec8718-2a55-4c46-aab1-70b5bfd802b9 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:31.041682 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2eec8718-2a55-4c46-aab1-70b5bfd802b9 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:31.042334 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2eec8718-2a55-4c46-aab1-70b5bfd802b9 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:31.042757 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2eec8718-2a55-4c46-aab1-70b5bfd802b9 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:31.194338 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2eec8718-2a55-4c46-aab1-70b5bfd802b9 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:31.206702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-2eec8718-2a55-4c46-aab1-70b5bfd802b9 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1755 microversion: 2.1 time: 0.178260 May 19 06:35:31.207589 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 259/518] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:31 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:35:31.693634 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0201ccf7-e6b4-4ff0-a74a-fa80112dbeb3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:31.694246 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0201ccf7-e6b4-4ff0-a74a-fa80112dbeb3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:31.700969 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0201ccf7-e6b4-4ff0-a74a-fa80112dbeb3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:31.701455 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0201ccf7-e6b4-4ff0-a74a-fa80112dbeb3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:31.702891 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0201ccf7-e6b4-4ff0-a74a-fa80112dbeb3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:31.703437 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0201ccf7-e6b4-4ff0-a74a-fa80112dbeb3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:31.837023 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0201ccf7-e6b4-4ff0-a74a-fa80112dbeb3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:31.845191 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0201ccf7-e6b4-4ff0-a74a-fa80112dbeb3 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1733 microversion: 2.1 time: 0.155736 May 19 06:35:31.845787 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 260/519] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:31 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:32.224058 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-05afdc9b-d3f9-4d95-8665-da11809f5c5e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:32.224650 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-05afdc9b-d3f9-4d95-8665-da11809f5c5e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:32.231412 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-05afdc9b-d3f9-4d95-8665-da11809f5c5e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:32.231860 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-05afdc9b-d3f9-4d95-8665-da11809f5c5e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:32.232643 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-05afdc9b-d3f9-4d95-8665-da11809f5c5e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:32.233079 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-05afdc9b-d3f9-4d95-8665-da11809f5c5e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:32.381328 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-05afdc9b-d3f9-4d95-8665-da11809f5c5e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:32.389226 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-05afdc9b-d3f9-4d95-8665-da11809f5c5e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1758 microversion: 2.1 time: 0.169118 May 19 06:35:32.390598 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 260/520] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:32 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:32.862898 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-8c58ec77-7ab7-4771-99dc-4569d33f008d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:32.863496 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-8c58ec77-7ab7-4771-99dc-4569d33f008d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:32.870081 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8c58ec77-7ab7-4771-99dc-4569d33f008d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:32.870615 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8c58ec77-7ab7-4771-99dc-4569d33f008d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:32.871372 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8c58ec77-7ab7-4771-99dc-4569d33f008d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:32.871806 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8c58ec77-7ab7-4771-99dc-4569d33f008d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:33.020776 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8c58ec77-7ab7-4771-99dc-4569d33f008d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:33.028971 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-8c58ec77-7ab7-4771-99dc-4569d33f008d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1733 microversion: 2.1 time: 0.170392 May 19 06:35:33.029562 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 261/521] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:32 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1733 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:34.048138 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-defb70aa-55c5-4f2e-b8c3-058f0a7fa103 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:34.048839 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-defb70aa-55c5-4f2e-b8c3-058f0a7fa103 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:34.054804 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-defb70aa-55c5-4f2e-b8c3-058f0a7fa103 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:34.055251 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-defb70aa-55c5-4f2e-b8c3-058f0a7fa103 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:34.056026 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-defb70aa-55c5-4f2e-b8c3-058f0a7fa103 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:34.056454 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-defb70aa-55c5-4f2e-b8c3-058f0a7fa103 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:34.200521 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-defb70aa-55c5-4f2e-b8c3-058f0a7fa103 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:34.209303 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-defb70aa-55c5-4f2e-b8c3-058f0a7fa103 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1733 microversion: 2.1 time: 0.165858 May 19 06:35:34.209895 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 261/522] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:34 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:35.227995 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-dcd423f8-fefa-4aa4-8d12-c4af00e5994b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:35.228617 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-dcd423f8-fefa-4aa4-8d12-c4af00e5994b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:35.236487 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dcd423f8-fefa-4aa4-8d12-c4af00e5994b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:35.236935 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dcd423f8-fefa-4aa4-8d12-c4af00e5994b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:35.237728 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dcd423f8-fefa-4aa4-8d12-c4af00e5994b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:35.238155 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dcd423f8-fefa-4aa4-8d12-c4af00e5994b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:35.374403 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-dcd423f8-fefa-4aa4-8d12-c4af00e5994b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:35.383651 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-dcd423f8-fefa-4aa4-8d12-c4af00e5994b tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1713 microversion: 2.1 time: 0.160733 May 19 06:35:35.384164 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 262/523] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:35 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1713 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:35.500249 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7967789f-bdbc-45a3-963c-e8174776cca7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:35.500249 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7967789f-bdbc-45a3-963c-e8174776cca7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:35.503254 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=48 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:35:35.508145 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7967789f-bdbc-45a3-963c-e8174776cca7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:35.508591 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7967789f-bdbc-45a3-963c-e8174776cca7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:35.509428 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7967789f-bdbc-45a3-963c-e8174776cca7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:35.509867 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7967789f-bdbc-45a3-963c-e8174776cca7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:35.607591 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-7967789f-bdbc-45a3-963c-e8174776cca7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] HTTP exception thrown: Cannot 'detach_volume' instance 3e905065-4c72-403f-ba1f-3d56ec56b4f0 while it is in vm_state rescued May 19 06:35:35.609934 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7967789f-bdbc-45a3-963c-e8174776cca7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Request method failure captured: May 19 06:35:35.609934 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: DELETE /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0/os-volume_attachments/dc901c90-4dfe-43fb-b856-e29064abd557 HTTP/1.1 May 19 06:35:35.609934 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:35:35.609934 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:35:35.609934 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:35:35.609934 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 0 May 19 06:35:35.609934 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:35:35.609934 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:35:35.609934 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:35:35.609934 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:35:35.609934 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheQuT8V1GDiMH0DOO30Tfiq0zqgfOKtmbZZVfRuQfUb8iaIztwspeMTxkuDLD2JCWzCPycgw0CBN7_rmViHiNTGxyVziGruF8U08SJ90dqoSpsfL2qSZ-4DDY3yRLv9LzIxqZGYSN8qlP4jViuesPcXSDJ7XSg52MZEFyD7v7uiamXU May 19 06:35:35.609934 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:35:35.609934 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:35:35.609934 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:35:35.609934 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:35:35.609934 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:35:35.609934 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:35:35.609934 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: 35cb15f2075c41889b91291b645170a5 May 19 06:35:35.609934 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-802710311 May 19 06:35:35.609934 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:35:35.609934 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:35:35.612670 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/35cb15f2075c41889b91291b645170a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/35cb15f2075c41889b91291b645170a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/35cb15f2075c41889b91291b645170a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_35cb15f2075c41889b91291b645170a5", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:35:35.612670 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-ServerRescueNegativeTestJSON-802710311 May 19 06:35:35.612670 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: 35cb15f2075c41889b91291b645170a5 May 19 06:35:35.612670 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-802710311 May 19 06:35:35.612670 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-ServerRescueNegativeTestJSON-802710311-project May 19 06:35:35.612670 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:35:35.612670 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:35:35.612670 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: 6a71c3c016564c3b9ab0b6b58d378fda May 19 06:35:35.612670 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-ServerRescueNegativeTestJSON-802710311-project May 19 06:35:35.612670 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: > May 19 06:35:35.612670 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Cannot 'detach_volume' instance 3e905065-4c72-403f-ba1f-3d56ec56b4f0 while it is in vm_state rescued May 19 06:35:35.614221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'server_id': '3e905065-4c72-403f-ba1f-3d56ec56b4f0', 'id': 'dc901c90-4dfe-43fb-b856-e29064abd557'} May 19 06:35:35.614221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:35:35.614221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:35:35.614221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 19 06:35:35.614221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 19 06:35:35.614221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 06:35:35.614221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 06:35:35.614221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 06:35:35.614221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 06:35:35.614221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3e905065-4c72-403f-ba1f-3d56ec56b4f0 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 19 06:35:35.614221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:35:35.614221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:35:35.614221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:35:35.614221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:35:35.614221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:35:35.614221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:35:35.614221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:35:35.614221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:35:35.614221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:35:35.614221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:35:35.616850 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 19 06:35:35.616850 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 06:35:35.616850 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 06:35:35.616850 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 06:35:35.616850 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3e905065-4c72-403f-ba1f-3d56ec56b4f0 while it is in vm_state rescued May 19 06:35:35.616850 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:35:35.616850 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:35:35.616850 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:35:35.616850 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:35:35.616850 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:35:35.616850 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:35:35.616850 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:35:35.616850 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:35:35.616850 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3e905065-4c72-403f-ba1f-3d56ec56b4f0 while it is in vm_state rescued May 19 06:35:35.616850 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:35:35.616850 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7967789f-bdbc-45a3-963c-e8174776cca7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Returning 409 to user: Cannot 'detach_volume' instance 3e905065-4c72-403f-ba1f-3d56ec56b4f0 while it is in vm_state rescued {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:35:35.618872 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7967789f-bdbc-45a3-963c-e8174776cca7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0/os-volume_attachments/dc901c90-4dfe-43fb-b856-e29064abd557" status: 409 len: 152 microversion: 2.1 time: 0.117486 May 19 06:35:35.618872 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 262/524] 10.222.0.65 () {58 vars in 1415 bytes} [Thu May 19 06:35:35 2022] DELETE /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0/os-volume_attachments/dc901c90-4dfe-43fb-b856-e29064abd557 => generated 152 bytes in 119 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 06:35:35.626876 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-11d6e640-c359-404e-8efb-327e94cba7a8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:35:35.627863 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-11d6e640-c359-404e-8efb-327e94cba7a8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:35.638906 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-11d6e640-c359-404e-8efb-327e94cba7a8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:35.639830 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-11d6e640-c359-404e-8efb-327e94cba7a8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:35.641975 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-11d6e640-c359-404e-8efb-327e94cba7a8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:35.642740 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-11d6e640-c359-404e-8efb-327e94cba7a8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:35.728737 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-11d6e640-c359-404e-8efb-327e94cba7a8 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "POST /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0/action" status: 202 len: 0 microversion: 2.1 time: 0.109358 May 19 06:35:35.735111 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 263/525] 10.222.0.65 () {60 vars in 1277 bytes} [Thu May 19 06:35:35 2022] POST /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 06:35:35.744509 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6e2a6355-a356-42fc-b1c7-2bd1d5655d50 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:35.745665 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6e2a6355-a356-42fc-b1c7-2bd1d5655d50 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:35.753835 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6e2a6355-a356-42fc-b1c7-2bd1d5655d50 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:35.754470 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6e2a6355-a356-42fc-b1c7-2bd1d5655d50 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:35.755329 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6e2a6355-a356-42fc-b1c7-2bd1d5655d50 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:35.755800 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6e2a6355-a356-42fc-b1c7-2bd1d5655d50 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:35.987088 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6e2a6355-a356-42fc-b1c7-2bd1d5655d50 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:35.996869 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6e2a6355-a356-42fc-b1c7-2bd1d5655d50 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1721 microversion: 2.1 time: 0.259650 May 19 06:35:35.997684 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 263/526] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:35 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1721 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:37.016247 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-07d65e45-30b6-4450-a124-c2cae01a342e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:37.016870 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-07d65e45-30b6-4450-a124-c2cae01a342e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:37.023463 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-07d65e45-30b6-4450-a124-c2cae01a342e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:37.023957 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-07d65e45-30b6-4450-a124-c2cae01a342e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:37.024763 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-07d65e45-30b6-4450-a124-c2cae01a342e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:37.025305 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-07d65e45-30b6-4450-a124-c2cae01a342e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:37.386697 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-07d65e45-30b6-4450-a124-c2cae01a342e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:37.395206 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-07d65e45-30b6-4450-a124-c2cae01a342e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1721 microversion: 2.1 time: 0.384692 May 19 06:35:37.395792 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 264/527] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:37 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1721 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:38.413065 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0a99e14e-dfda-4295-b49e-781833422e0c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:38.415268 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0a99e14e-dfda-4295-b49e-781833422e0c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:38.420480 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0a99e14e-dfda-4295-b49e-781833422e0c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:38.420918 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0a99e14e-dfda-4295-b49e-781833422e0c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:38.421709 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0a99e14e-dfda-4295-b49e-781833422e0c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:38.422133 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0a99e14e-dfda-4295-b49e-781833422e0c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:38.631485 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0a99e14e-dfda-4295-b49e-781833422e0c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:38.641558 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0a99e14e-dfda-4295-b49e-781833422e0c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1721 microversion: 2.1 time: 0.231967 May 19 06:35:38.642727 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 264/528] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:38 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1721 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:39.659848 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-402ccb46-c186-41be-ba76-2aa52ef4eef0 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:39.660470 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-402ccb46-c186-41be-ba76-2aa52ef4eef0 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:39.667511 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-402ccb46-c186-41be-ba76-2aa52ef4eef0 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:39.667962 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-402ccb46-c186-41be-ba76-2aa52ef4eef0 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:39.668752 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-402ccb46-c186-41be-ba76-2aa52ef4eef0 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:39.669186 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-402ccb46-c186-41be-ba76-2aa52ef4eef0 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:39.818782 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-402ccb46-c186-41be-ba76-2aa52ef4eef0 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:39.828049 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-402ccb46-c186-41be-ba76-2aa52ef4eef0 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1727 microversion: 2.1 time: 0.172606 May 19 06:35:39.828638 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 265/529] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:39 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:35:39.846125 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-79dde1e2-9d74-4d91-a54d-c985c7e987b0 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:39.846813 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-79dde1e2-9d74-4d91-a54d-c985c7e987b0 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:39.853683 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-79dde1e2-9d74-4d91-a54d-c985c7e987b0 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:39.854130 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-79dde1e2-9d74-4d91-a54d-c985c7e987b0 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:39.854900 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-79dde1e2-9d74-4d91-a54d-c985c7e987b0 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:39.855335 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-79dde1e2-9d74-4d91-a54d-c985c7e987b0 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:39.953361 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-79dde1e2-9d74-4d91-a54d-c985c7e987b0 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110662 May 19 06:35:39.954001 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 265/530] 10.222.0.65 () {58 vars in 1274 bytes} [Thu May 19 06:35:39 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:35:40.970961 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-26c27856-8c40-49f2-aca7-b89937c23748 req-e21839c0-5b20-4ec7-a49c-09f6f547e341 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e905065-4c72-403f-ba1f-3d56ec56b4f0", "tag": "e9987cd3-ff74-46e7-8754-720b4458b23e"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:35:40.981077 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-26c27856-8c40-49f2-aca7-b89937c23748 req-e21839c0-5b20-4ec7-a49c-09f6f547e341 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:40.981579 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-26c27856-8c40-49f2-aca7-b89937c23748 req-e21839c0-5b20-4ec7-a49c-09f6f547e341 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:40.995276 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-26c27856-8c40-49f2-aca7-b89937c23748 req-e21839c0-5b20-4ec7-a49c-09f6f547e341 service nova] Creating event network-changed:e9987cd3-ff74-46e7-8754-720b4458b23e for instance 3e905065-4c72-403f-ba1f-3d56ec56b4f0 on hv-cinder-83699 May 19 06:35:41.003751 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-26c27856-8c40-49f2-aca7-b89937c23748 req-e21839c0-5b20-4ec7-a49c-09f6f547e341 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037155 May 19 06:35:41.004362 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 266/531] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:35:43.020442 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-dea8046b-4963-428b-8b40-7789b4108fa3 req-4c51bbe7-6ea8-4b9d-a0a9-0d22592a2fdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e905065-4c72-403f-ba1f-3d56ec56b4f0", "tag": "e9987cd3-ff74-46e7-8754-720b4458b23e"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:35:43.029265 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-dea8046b-4963-428b-8b40-7789b4108fa3 req-4c51bbe7-6ea8-4b9d-a0a9-0d22592a2fdb service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:43.030272 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-dea8046b-4963-428b-8b40-7789b4108fa3 req-4c51bbe7-6ea8-4b9d-a0a9-0d22592a2fdb service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:43.043113 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-dea8046b-4963-428b-8b40-7789b4108fa3 req-4c51bbe7-6ea8-4b9d-a0a9-0d22592a2fdb service nova] Creating event network-changed:e9987cd3-ff74-46e7-8754-720b4458b23e for instance 3e905065-4c72-403f-ba1f-3d56ec56b4f0 on hv-cinder-83699 May 19 06:35:43.049740 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-dea8046b-4963-428b-8b40-7789b4108fa3 req-4c51bbe7-6ea8-4b9d-a0a9-0d22592a2fdb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035120 May 19 06:35:43.050329 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 266/532] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:35:45.480173 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-cfe21d14-34ff-4930-9ef3-21d245e087cb tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:45.480782 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-cfe21d14-34ff-4930-9ef3-21d245e087cb tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: a0707826-af06-4e43-8b88-8243dd68c7be] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:45.483174 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=46 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:35:45.489110 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cfe21d14-34ff-4930-9ef3-21d245e087cb tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:45.489585 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cfe21d14-34ff-4930-9ef3-21d245e087cb tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:45.490367 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cfe21d14-34ff-4930-9ef3-21d245e087cb tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:45.490805 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cfe21d14-34ff-4930-9ef3-21d245e087cb tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:45.517759 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-cfe21d14-34ff-4930-9ef3-21d245e087cb tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be/ips" status: 200 len: 150 microversion: 2.1 time: 0.042456 May 19 06:35:45.518355 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 267/533] 10.222.0.65 () {58 vars in 1247 bytes} [Thu May 19 06:35:45 2022] GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:35:46.920365 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-79c892b4-a0ec-4bc2-a9d7-6509a9caaac0 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0badd57-27db-4af7-aa06-7c5d6963f8a6"}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:35:46.921711 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-79c892b4-a0ec-4bc2-a9d7-6509a9caaac0 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: a0707826-af06-4e43-8b88-8243dd68c7be] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:46.928112 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-79c892b4-a0ec-4bc2-a9d7-6509a9caaac0 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:46.928563 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-79c892b4-a0ec-4bc2-a9d7-6509a9caaac0 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:46.929356 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-79c892b4-a0ec-4bc2-a9d7-6509a9caaac0 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:46.929787 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-79c892b4-a0ec-4bc2-a9d7-6509a9caaac0 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:47.214162 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-79c892b4-a0ec-4bc2-a9d7-6509a9caaac0 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "POST /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298565 May 19 06:35:47.214815 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 267/534] 10.222.0.65 () {60 vars in 1322 bytes} [Thu May 19 06:35:46 2022] POST /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:35:50.287123 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-94691c43-2591-4c61-b83c-8dbb9a955b43 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:50.288077 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-94691c43-2591-4c61-b83c-8dbb9a955b43 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:50.296161 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-94691c43-2591-4c61-b83c-8dbb9a955b43 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:50.296877 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-94691c43-2591-4c61-b83c-8dbb9a955b43 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:50.297124 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-94691c43-2591-4c61-b83c-8dbb9a955b43 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:50.297601 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-94691c43-2591-4c61-b83c-8dbb9a955b43 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:50.331380 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-94691c43-2591-4c61-b83c-8dbb9a955b43 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048447 May 19 06:35:50.332193 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 268/535] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 06:35:50 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 06:35:50.412937 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8e9d1800-7ec7-46e2-9da8-d711ed7be2a1 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:50.413615 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8e9d1800-7ec7-46e2-9da8-d711ed7be2a1 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:50.424168 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8e9d1800-7ec7-46e2-9da8-d711ed7be2a1 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:50.425173 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8e9d1800-7ec7-46e2-9da8-d711ed7be2a1 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:50.426598 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8e9d1800-7ec7-46e2-9da8-d711ed7be2a1 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:50.427456 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8e9d1800-7ec7-46e2-9da8-d711ed7be2a1 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:50.474806 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8e9d1800-7ec7-46e2-9da8-d711ed7be2a1 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Going to try to terminate instance {{(pid=117711) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 06:35:50.580094 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8e9d1800-7ec7-46e2-9da8-d711ed7be2a1 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "DELETE /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 204 len: 0 microversion: 2.1 time: 0.170119 May 19 06:35:50.581014 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 268/536] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 06:35:50 2022] DELETE /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 06:35:50.596450 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-37657f7c-b612-44e0-94b5-e31d26646444 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:50.597687 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-37657f7c-b612-44e0-94b5-e31d26646444 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:50.608202 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-37657f7c-b612-44e0-94b5-e31d26646444 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:50.608962 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-37657f7c-b612-44e0-94b5-e31d26646444 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:50.610301 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-37657f7c-b612-44e0-94b5-e31d26646444 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:50.611047 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-37657f7c-b612-44e0-94b5-e31d26646444 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:50.781543 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-37657f7c-b612-44e0-94b5-e31d26646444 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:50.789598 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-37657f7c-b612-44e0-94b5-e31d26646444 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1675 microversion: 2.1 time: 0.202229 May 19 06:35:50.790190 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 269/537] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:50 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1675 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:51.808416 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a86ec0fc-4df6-4cbe-beba-f75ffaa8b59d tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:51.809164 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a86ec0fc-4df6-4cbe-beba-f75ffaa8b59d tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:51.817108 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a86ec0fc-4df6-4cbe-beba-f75ffaa8b59d tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:51.817612 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a86ec0fc-4df6-4cbe-beba-f75ffaa8b59d tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:51.818391 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a86ec0fc-4df6-4cbe-beba-f75ffaa8b59d tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:51.818824 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a86ec0fc-4df6-4cbe-beba-f75ffaa8b59d tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:51.979363 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a86ec0fc-4df6-4cbe-beba-f75ffaa8b59d tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:51.988996 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a86ec0fc-4df6-4cbe-beba-f75ffaa8b59d tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1675 microversion: 2.1 time: 0.184998 May 19 06:35:51.989627 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 269/538] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:51 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1675 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:53.006474 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b920eb8d-a36e-463e-a868-72a0b31731cc tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:53.007268 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b920eb8d-a36e-463e-a868-72a0b31731cc tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:53.014939 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b920eb8d-a36e-463e-a868-72a0b31731cc tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:53.015534 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b920eb8d-a36e-463e-a868-72a0b31731cc tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:53.016399 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b920eb8d-a36e-463e-a868-72a0b31731cc tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:53.016908 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b920eb8d-a36e-463e-a868-72a0b31731cc tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:53.168008 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b920eb8d-a36e-463e-a868-72a0b31731cc tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:53.176792 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b920eb8d-a36e-463e-a868-72a0b31731cc tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1675 microversion: 2.1 time: 0.174133 May 19 06:35:53.177406 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 270/539] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:53 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:35:54.195919 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-4cd497d4-c3b4-480c-a3ab-aad93ae6e12e req-835aace0-5f49-4be2-8822-3c02365d9266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab7664a1-4da9-4338-996f-82bf458729ac", "name": "network-vif-deleted", "tag": "a273e96a-f26e-4d91-b813-288465dd486f"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:35:54.202544 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-dde7ec36-1fa8-45d2-b6ca-959fc99247d6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:54.203830 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-dde7ec36-1fa8-45d2-b6ca-959fc99247d6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:54.215598 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-4cd497d4-c3b4-480c-a3ab-aad93ae6e12e req-835aace0-5f49-4be2-8822-3c02365d9266 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:54.216189 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-4cd497d4-c3b4-480c-a3ab-aad93ae6e12e req-835aace0-5f49-4be2-8822-3c02365d9266 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:54.223073 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dde7ec36-1fa8-45d2-b6ca-959fc99247d6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:54.226042 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dde7ec36-1fa8-45d2-b6ca-959fc99247d6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:54.227367 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dde7ec36-1fa8-45d2-b6ca-959fc99247d6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:54.227367 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dde7ec36-1fa8-45d2-b6ca-959fc99247d6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:54.240451 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-4cd497d4-c3b4-480c-a3ab-aad93ae6e12e req-835aace0-5f49-4be2-8822-3c02365d9266 service nova] Creating event network-vif-deleted:a273e96a-f26e-4d91-b813-288465dd486f for instance ab7664a1-4da9-4338-996f-82bf458729ac on hv-cinder-83699 May 19 06:35:54.259505 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-4cd497d4-c3b4-480c-a3ab-aad93ae6e12e req-835aace0-5f49-4be2-8822-3c02365d9266 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074914 May 19 06:35:54.265923 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 270/540] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:35:54.336725 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-dde7ec36-1fa8-45d2-b6ca-959fc99247d6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:54.352662 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-dde7ec36-1fa8-45d2-b6ca-959fc99247d6 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 200 len: 1608 microversion: 2.1 time: 0.159977 May 19 06:35:54.353754 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 271/541] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:54 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 1608 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:54.892574 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d0dc1536-e7e4-49cc-95ba-55dd02339bcc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0badd57-27db-4af7-aa06-7c5d6963f8a6"}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:35:54.894020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d0dc1536-e7e4-49cc-95ba-55dd02339bcc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: a0707826-af06-4e43-8b88-8243dd68c7be] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:54.901076 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d0dc1536-e7e4-49cc-95ba-55dd02339bcc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:54.901479 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d0dc1536-e7e4-49cc-95ba-55dd02339bcc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:54.902534 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d0dc1536-e7e4-49cc-95ba-55dd02339bcc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:54.902967 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d0dc1536-e7e4-49cc-95ba-55dd02339bcc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:55.005902 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-d0dc1536-e7e4-49cc-95ba-55dd02339bcc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] HTTP exception thrown: Invalid volume: volume c0badd57-27db-4af7-aa06-7c5d6963f8a6 is already attached to instances: a0707826-af06-4e43-8b88-8243dd68c7be May 19 06:35:55.007671 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d0dc1536-e7e4-49cc-95ba-55dd02339bcc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Request method failure captured: May 19 06:35:55.007671 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: POST /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be/os-volume_attachments HTTP/1.1 May 19 06:35:55.007671 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:35:55.007671 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:35:55.007671 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:35:55.007671 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 74 May 19 06:35:55.007671 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:35:55.007671 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:35:55.007671 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:35:55.007671 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:35:55.007671 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheQpEYHNc-bqZDbTw7Fp3ihyV0ldXUTzVqdWql59X0rABgHWrMJ_mmqGdwFukt62XCeg2LJEaWYizlEXJ-MFBwGucN9hE2YUn-VSsy8oJQ2x49K6gk4QQGlP2u7BGs_KXICLfWCW8W72y7YMhrOqThFt82dOSFW0U-RORzkOxIAljYo May 19 06:35:55.007671 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:35:55.007671 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:35:55.007671 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:35:55.007671 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:35:55.007671 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:35:55.007671 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:35:55.007671 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: adbcff8654844c22a906a2e91ebca3bb May 19 06:35:55.007671 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-AttachVolumeNegativeTest-624051308 May 19 06:35:55.007671 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:35:55.007671 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:35:55.010031 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_adbcff8654844c22a906a2e91ebca3bb", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:35:55.010031 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-AttachVolumeNegativeTest-624051308 May 19 06:35:55.010031 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: adbcff8654844c22a906a2e91ebca3bb May 19 06:35:55.010031 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-624051308 May 19 06:35:55.010031 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-AttachVolumeNegativeTest-624051308-project May 19 06:35:55.010031 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:35:55.010031 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:35:55.010031 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: cb2bf8531dfe42b29b0b632b39d49625 May 19 06:35:55.010031 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-AttachVolumeNegativeTest-624051308-project May 19 06:35:55.010031 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: May 19 06:35:55.010031 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {"volumeAttachment": {"volumeId": "c0badd57-27db-4af7-aa06-7c5d6963f8a6"}} May 19 06:35:55.010031 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: > May 19 06:35:55.011192 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Invalid volume: volume c0badd57-27db-4af7-aa06-7c5d6963f8a6 is already attached to instances: a0707826-af06-4e43-8b88-8243dd68c7be May 19 06:35:55.011192 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'server_id': 'a0707826-af06-4e43-8b88-8243dd68c7be', 'body': {'volumeAttachment': {'volumeId': 'c0badd57-27db-4af7-aa06-7c5d6963f8a6'}}} May 19 06:35:55.011192 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:35:55.011192 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:35:55.011192 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 19 06:35:55.011192 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 19 06:35:55.011192 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 06:35:55.011192 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 06:35:55.011192 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 19 06:35:55.011192 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 06:35:55.011192 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 19 06:35:55.011192 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 19 06:35:55.011192 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 19 06:35:55.011192 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 19 06:35:55.011192 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c0badd57-27db-4af7-aa06-7c5d6963f8a6 is already attached to instances: a0707826-af06-4e43-8b88-8243dd68c7be May 19 06:35:55.011192 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:35:55.011192 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:35:55.011192 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:35:55.011192 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:35:55.012877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:35:55.012877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:35:55.012877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:35:55.012877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:35:55.012877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:35:55.012877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:35:55.012877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 06:35:55.012877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 06:35:55.012877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 06:35:55.012877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 06:35:55.012877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 06:35:55.012877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 06:35:55.012877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 19 06:35:55.012877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 19 06:35:55.012877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c0badd57-27db-4af7-aa06-7c5d6963f8a6 is already attached to instances: a0707826-af06-4e43-8b88-8243dd68c7be May 19 06:35:55.012877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:35:55.012877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:35:55.012877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:35:55.012877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:35:55.012877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:35:55.016201 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:35:55.016201 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:35:55.016201 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:35:55.016201 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c0badd57-27db-4af7-aa06-7c5d6963f8a6 is already attached to instances: a0707826-af06-4e43-8b88-8243dd68c7be May 19 06:35:55.016201 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:35:55.016201 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d0dc1536-e7e4-49cc-95ba-55dd02339bcc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Returning 400 to user: Invalid volume: volume c0badd57-27db-4af7-aa06-7c5d6963f8a6 is already attached to instances: a0707826-af06-4e43-8b88-8243dd68c7be {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:35:55.016201 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d0dc1536-e7e4-49cc-95ba-55dd02339bcc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "POST /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.121948 May 19 06:35:55.016201 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 271/542] 10.222.0.65 () {60 vars in 1322 bytes} [Thu May 19 06:35:54 2022] POST /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be/os-volume_attachments => generated 174 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 06:35:55.090073 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-562a2f42-599a-4806-8403-d8871dac7244 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:55.090575 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-562a2f42-599a-4806-8403-d8871dac7244 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: a0707826-af06-4e43-8b88-8243dd68c7be] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:55.097797 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-562a2f42-599a-4806-8403-d8871dac7244 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:55.098243 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-562a2f42-599a-4806-8403-d8871dac7244 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:55.099013 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-562a2f42-599a-4806-8403-d8871dac7244 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:55.099639 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-562a2f42-599a-4806-8403-d8871dac7244 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:55.210227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:35:55.216836 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-562a2f42-599a-4806-8403-d8871dac7244 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lazy-loading 'services' on Instance uuid a0707826-af06-4e43-8b88-8243dd68c7be {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:35:55.320067 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-562a2f42-599a-4806-8403-d8871dac7244 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be/os-volume_attachments/c0badd57-27db-4af7-aa06-7c5d6963f8a6" status: 202 len: 0 microversion: 2.1 time: 0.233283 May 19 06:35:55.321374 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 272/543] 10.222.0.65 () {58 vars in 1415 bytes} [Thu May 19 06:35:55 2022] DELETE /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be/os-volume_attachments/c0badd57-27db-4af7-aa06-7c5d6963f8a6 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 06:35:55.332080 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-250dc197-2fdd-4553-8f52-5db2f10ff463 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:55.333017 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-250dc197-2fdd-4553-8f52-5db2f10ff463 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: a0707826-af06-4e43-8b88-8243dd68c7be] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:55.346996 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-250dc197-2fdd-4553-8f52-5db2f10ff463 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:55.347852 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-250dc197-2fdd-4553-8f52-5db2f10ff463 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:55.348982 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-250dc197-2fdd-4553-8f52-5db2f10ff463 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:55.349495 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-250dc197-2fdd-4553-8f52-5db2f10ff463 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:55.378189 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-fd9a5079-c792-4aaf-a9e4-c9e3aec0eaad tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:55.380439 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-fd9a5079-c792-4aaf-a9e4-c9e3aec0eaad tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:55.393938 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fd9a5079-c792-4aaf-a9e4-c9e3aec0eaad tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:55.395009 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fd9a5079-c792-4aaf-a9e4-c9e3aec0eaad tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:55.397320 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fd9a5079-c792-4aaf-a9e4-c9e3aec0eaad tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:55.399093 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-250dc197-2fdd-4553-8f52-5db2f10ff463 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070785 May 19 06:35:55.400310 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 272/544] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 06:35:55 2022] GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:35:55.402209 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fd9a5079-c792-4aaf-a9e4-c9e3aec0eaad tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:55.421868 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-fd9a5079-c792-4aaf-a9e4-c9e3aec0eaad tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] HTTP exception thrown: Instance ab7664a1-4da9-4338-996f-82bf458729ac could not be found. May 19 06:35:55.423766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-fd9a5079-c792-4aaf-a9e4-c9e3aec0eaad tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Request method failure captured: May 19 06:35:55.423766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac HTTP/1.1 May 19 06:35:55.423766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept: application/json May 19 06:35:55.423766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity May 19 06:35:55.423766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Connection: close May 19 06:35:55.423766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Length: 0 May 19 06:35:55.423766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Type: application/json May 19 06:35:55.423766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Host: 10.222.0.65 May 19 06:35:55.423766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None May 19 06:35:55.423766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 May 19 06:35:55.423766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiheQs5RxhNh599UW6hV5fPo6RDii2CBmb6-7-nZszVUgrqA2xFuzrtMyVWtLzjqLwk5EXhhuxA-Z7zkA0KrslrwqFRZJdr1gYO573BbyiEOoenZlHCaOQSo7977N0bxN_n9DlF_BdRmvDT13BEblTTl_tpdsNyOm1e-NqQpCuQT-xfz4 May 19 06:35:55.423766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Id: None May 19 06:35:55.423766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Name: None May 19 06:35:55.423766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed May 19 06:35:55.423766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True May 19 06:35:55.423766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default May 19 06:35:55.423766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default May 19 06:35:55.423766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Id: 1e8f1e4b9cd9432b90cb00a6be4d909e May 19 06:35:55.423766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-AttachVolumeTestJSON-1571186974 May 19 06:35:55.423766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Role: reader,member May 19 06:35:55.423766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Roles: reader,member May 19 06:35:55.425124 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1e8f1e4b9cd9432b90cb00a6be4d909e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1e8f1e4b9cd9432b90cb00a6be4d909e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1e8f1e4b9cd9432b90cb00a6be4d909e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1e8f1e4b9cd9432b90cb00a6be4d909e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:35:55.425124 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-AttachVolumeTestJSON-1571186974 May 19 06:35:55.425124 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Id: 1e8f1e4b9cd9432b90cb00a6be4d909e May 19 06:35:55.425124 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1571186974 May 19 06:35:55.425124 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User: tempest-AttachVolumeTestJSON-1571186974-project May 19 06:35:55.425124 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default May 19 06:35:55.425124 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default May 19 06:35:55.425124 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Id: 7a3536012d1444a1b9b606c9ec94e5cf May 19 06:35:55.425124 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-AttachVolumeTestJSON-1571186974-project May 19 06:35:55.425124 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: method: > May 19 06:35:55.425124 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: exception: Instance ab7664a1-4da9-4338-996f-82bf458729ac could not be found. May 19 06:35:55.425124 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: action_args: {'id': 'ab7664a1-4da9-4338-996f-82bf458729ac'} May 19 06:35:55.425986 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:35:55.425986 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:35:55.425986 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:35:55.425986 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:35:55.425986 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:35:55.425986 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:35:55.425986 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:35:55.425986 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:35:55.425986 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:35:55.425986 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:35:55.425986 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab7664a1-4da9-4338-996f-82bf458729ac could not be found. May 19 06:35:55.425986 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:35:55.425986 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:35:55.425986 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:35:55.425986 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:35:55.425986 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:35:55.425986 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:35:55.425986 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:35:55.425986 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:35:55.425986 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:35:55.427183 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:35:55.427183 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:35:55.427183 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:35:55.427183 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:35:55.427183 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:35:55.427183 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:35:55.427183 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:35:55.427183 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab7664a1-4da9-4338-996f-82bf458729ac could not be found. May 19 06:35:55.427183 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:35:55.427183 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:35:55.427183 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:35:55.427183 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:35:55.427183 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:35:55.427183 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:35:55.427183 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:35:55.427183 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:35:55.427183 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab7664a1-4da9-4338-996f-82bf458729ac could not be found. May 19 06:35:55.427183 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:35:55.428344 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-fd9a5079-c792-4aaf-a9e4-c9e3aec0eaad tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Returning 404 to user: Instance ab7664a1-4da9-4338-996f-82bf458729ac could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:35:55.428344 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-fd9a5079-c792-4aaf-a9e4-c9e3aec0eaad tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 404 len: 111 microversion: 2.1 time: 0.057192 May 19 06:35:55.428344 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 273/545] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:55 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:35:55.436884 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-99ec1685-4bb9-45c1-ba6d-a163dfd16d44 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '.version_select at 0x7f9aeb6bc550>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:55.465764 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-99ec1685-4bb9-45c1-ba6d-a163dfd16d44 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1003694897" status: 202 len: 0 microversion: 2.1 time: 0.034259 May 19 06:35:55.466783 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 273/546] 10.222.0.65 () {58 vars in 1220 bytes} [Thu May 19 06:35:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1003694897 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 06:35:56.416130 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-11515e88-ccb3-452d-a754-3414589012cc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:56.417165 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-11515e88-ccb3-452d-a754-3414589012cc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: a0707826-af06-4e43-8b88-8243dd68c7be] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:56.425489 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-11515e88-ccb3-452d-a754-3414589012cc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:56.425995 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-11515e88-ccb3-452d-a754-3414589012cc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:56.426706 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-11515e88-ccb3-452d-a754-3414589012cc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:56.427144 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-11515e88-ccb3-452d-a754-3414589012cc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:56.461799 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-11515e88-ccb3-452d-a754-3414589012cc tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050826 May 19 06:35:56.462383 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 274/547] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 06:35:56 2022] GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 06:35:56.497269 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-210235a9-1140-4378-b86a-93b7c66c9405 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Action: 'create', calling method: .version_select at 0x7f9aeb582af0>, body: {"keypair": {"name": "tempest-keypair-1652551517", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJK4g68AL9O1wfSIixNZQayz9mioJCysoCGmd5DqdTC7p9v6zDTYbTSMPPLTDqOzVncUfwT22lQfjb+prEBAkIVktcND6j05QaU4Rqp1/nZMMU1nieTt6jqwauPqRJkgEg=="}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:35:56.515984 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-210235a9-1140-4378-b86a-93b7c66c9405 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Getting quotas for project 1e8f1e4b9cd9432b90cb00a6be4d909e. Resources: {'key_pairs'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:35:56.520487 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-210235a9-1140-4378-b86a-93b7c66c9405 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Getting quotas for user 7a3536012d1444a1b9b606c9ec94e5cf and project 1e8f1e4b9cd9432b90cb00a6be4d909e. Resources: {'key_pairs'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:35:56.542422 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c2914b95-51c8-4091-aa4f-11b2aa7b9e8f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:56.542890 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c2914b95-51c8-4091-aa4f-11b2aa7b9e8f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: a0707826-af06-4e43-8b88-8243dd68c7be] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:56.549635 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c2914b95-51c8-4091-aa4f-11b2aa7b9e8f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:56.550091 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c2914b95-51c8-4091-aa4f-11b2aa7b9e8f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:56.550869 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c2914b95-51c8-4091-aa4f-11b2aa7b9e8f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:56.551309 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c2914b95-51c8-4091-aa4f-11b2aa7b9e8f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:56.551914 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-210235a9-1140-4378-b86a-93b7c66c9405 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059828 May 19 06:35:56.552955 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 274/548] 10.222.0.65 () {60 vars in 1158 bytes} [Thu May 19 06:35:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:35:56.594988 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c2914b95-51c8-4091-aa4f-11b2aa7b9e8f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: a0707826-af06-4e43-8b88-8243dd68c7be] Going to try to terminate instance {{(pid=117712) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 06:35:56.700560 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c2914b95-51c8-4091-aa4f-11b2aa7b9e8f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be" status: 204 len: 0 microversion: 2.1 time: 0.163583 May 19 06:35:56.701745 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 275/549] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 06:35:56 2022] DELETE /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 06:35:56.712446 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-70a355df-6577-4c35-bd0c-a362af73dfba tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:56.713091 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-70a355df-6577-4c35-bd0c-a362af73dfba tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: a0707826-af06-4e43-8b88-8243dd68c7be] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:56.722658 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-70a355df-6577-4c35-bd0c-a362af73dfba tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:56.723263 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-70a355df-6577-4c35-bd0c-a362af73dfba tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:56.724072 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-70a355df-6577-4c35-bd0c-a362af73dfba tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:56.724657 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-70a355df-6577-4c35-bd0c-a362af73dfba tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:56.943879 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-70a355df-6577-4c35-bd0c-a362af73dfba tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:56.946902 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:35:56.955977 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-70a355df-6577-4c35-bd0c-a362af73dfba tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be" status: 200 len: 1683 microversion: 2.1 time: 0.248366 May 19 06:35:56.956744 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 275/550] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:56 2022] GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be => generated 1683 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:57.974636 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-adf3820c-0e89-4c23-ac55-bc7f1ce1faf5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:57.975372 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-adf3820c-0e89-4c23-ac55-bc7f1ce1faf5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: a0707826-af06-4e43-8b88-8243dd68c7be] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:57.981918 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-adf3820c-0e89-4c23-ac55-bc7f1ce1faf5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:57.982578 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-adf3820c-0e89-4c23-ac55-bc7f1ce1faf5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:57.983211 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-adf3820c-0e89-4c23-ac55-bc7f1ce1faf5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:57.983643 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-adf3820c-0e89-4c23-ac55-bc7f1ce1faf5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:58.106937 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6c3b1217-8ac9-4ac6-b152-8445be372707 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-542177866", "imageRef": "27959167-098e-44c5-ba0a-e9fb8054c377", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e0cb90c-268e-45c0-ad67-af1b766db048"}], "security_groups": [{"name": "tempest-securitygroup--742458185"}], "key_name": "tempest-keypair-1652551517", "user_data": "}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:35:58.142515 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-adf3820c-0e89-4c23-ac55-bc7f1ce1faf5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:58.151281 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-adf3820c-0e89-4c23-ac55-bc7f1ce1faf5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be" status: 200 len: 1683 microversion: 2.1 time: 0.180648 May 19 06:35:58.152101 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 276/551] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:57 2022] GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be => generated 1683 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:58.235749 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.network.neutron [None req-6c3b1217-8ac9-4ac6-b152-8445be372707 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] validate_networks() for [('3e0cb90c-268e-45c0-ad67-af1b766db048', None, None, None, None, None)] {{(pid=117711) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 06:35:58.943702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-6c3b1217-8ac9-4ac6-b152-8445be372707 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Flavor limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 06:35:58.944133 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-6c3b1217-8ac9-4ac6-b152-8445be372707 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Image limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 06:35:58.944618 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-6c3b1217-8ac9-4ac6-b152-8445be372707 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Flavor pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 06:35:58.945028 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-6c3b1217-8ac9-4ac6-b152-8445be372707 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Image pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 06:35:58.945499 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-6c3b1217-8ac9-4ac6-b152-8445be372707 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 06:35:58.956242 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6c3b1217-8ac9-4ac6-b152-8445be372707 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:58.956688 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6c3b1217-8ac9-4ac6-b152-8445be372707 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:58.957527 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6c3b1217-8ac9-4ac6-b152-8445be372707 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:58.957965 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6c3b1217-8ac9-4ac6-b152-8445be372707 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:58.979607 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-6c3b1217-8ac9-4ac6-b152-8445be372707 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Getting quotas for project 1e8f1e4b9cd9432b90cb00a6be4d909e. Resources: {'ram', 'cores', 'instances'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:35:58.986235 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-6c3b1217-8ac9-4ac6-b152-8445be372707 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Getting quotas for user 7a3536012d1444a1b9b606c9ec94e5cf and project 1e8f1e4b9cd9432b90cb00a6be4d909e. Resources: {'ram', 'cores', 'instances'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:35:59.005106 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6c3b1217-8ac9-4ac6-b152-8445be372707 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Going to run 1 instances... {{(pid=117711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 06:35:59.009924 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6c3b1217-8ac9-4ac6-b152-8445be372707 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27959167-098e-44c5-ba0a-e9fb8054c377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 06:35:59.104259 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6c3b1217-8ac9-4ac6-b152-8445be372707 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.001279 May 19 06:35:59.105839 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 276/552] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 06:35:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 06:35:59.121209 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b967fa5c-594e-43bf-a399-b7974272e881 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:59.122070 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b967fa5c-594e-43bf-a399-b7974272e881 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:59.189954 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b967fa5c-594e-43bf-a399-b7974272e881 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:59.190266 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-65aa0397-b747-4414-a5a5-22a2ca84c7bf tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:35:59.192719 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-65aa0397-b747-4414-a5a5-22a2ca84c7bf tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: a0707826-af06-4e43-8b88-8243dd68c7be] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:35:59.199046 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b967fa5c-594e-43bf-a399-b7974272e881 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635" status: 200 len: 1237 microversion: 2.1 time: 0.082880 May 19 06:35:59.200427 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 277/553] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:59 2022] GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635 => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:59.213231 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-65aa0397-b747-4414-a5a5-22a2ca84c7bf tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:59.214892 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-65aa0397-b747-4414-a5a5-22a2ca84c7bf tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:59.216443 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-65aa0397-b747-4414-a5a5-22a2ca84c7bf tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:59.218276 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-65aa0397-b747-4414-a5a5-22a2ca84c7bf tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:59.659265 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-65aa0397-b747-4414-a5a5-22a2ca84c7bf tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:35:59.680052 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-65aa0397-b747-4414-a5a5-22a2ca84c7bf tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be" status: 200 len: 1683 microversion: 2.1 time: 0.513212 May 19 06:35:59.681868 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 277/554] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:35:59 2022] GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be => generated 1683 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:35:59.920292 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-83c05fd8-3e60-417d-a8a0-62c1fd192062 req-b4c974f1-12fb-473c-a966-0759e3c50fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0707826-af06-4e43-8b88-8243dd68c7be", "name": "network-vif-deleted", "tag": "69e8e332-0f9f-4517-87be-fc3fabb6ba48"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:35:59.937759 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-83c05fd8-3e60-417d-a8a0-62c1fd192062 req-b4c974f1-12fb-473c-a966-0759e3c50fc4 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:35:59.938222 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-83c05fd8-3e60-417d-a8a0-62c1fd192062 req-b4c974f1-12fb-473c-a966-0759e3c50fc4 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:35:59.960137 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-83c05fd8-3e60-417d-a8a0-62c1fd192062 req-b4c974f1-12fb-473c-a966-0759e3c50fc4 service nova] Creating event network-vif-deleted:69e8e332-0f9f-4517-87be-fc3fabb6ba48 for instance a0707826-af06-4e43-8b88-8243dd68c7be on hv-cinder-83699 May 19 06:35:59.967552 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-83c05fd8-3e60-417d-a8a0-62c1fd192062 req-b4c974f1-12fb-473c-a966-0759e3c50fc4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051498 May 19 06:35:59.968583 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 278/555] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:36:00.231765 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8909a098-2fd3-4734-b07a-657baf1846c9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:00.233740 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8909a098-2fd3-4734-b07a-657baf1846c9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:00.246515 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8909a098-2fd3-4734-b07a-657baf1846c9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:00.247335 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8909a098-2fd3-4734-b07a-657baf1846c9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:00.249321 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8909a098-2fd3-4734-b07a-657baf1846c9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:00.249818 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8909a098-2fd3-4734-b07a-657baf1846c9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:00.347519 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-8909a098-2fd3-4734-b07a-657baf1846c9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:00.355404 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8909a098-2fd3-4734-b07a-657baf1846c9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635" status: 200 len: 1289 microversion: 2.1 time: 0.132021 May 19 06:36:00.356189 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 278/556] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:00 2022] GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635 => generated 1289 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:36:00.712573 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-554cc6ed-285e-4be2-9587-2e118a4616c8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:00.714683 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-554cc6ed-285e-4be2-9587-2e118a4616c8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: a0707826-af06-4e43-8b88-8243dd68c7be] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:00.728580 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-554cc6ed-285e-4be2-9587-2e118a4616c8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:00.730181 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-554cc6ed-285e-4be2-9587-2e118a4616c8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:00.732605 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-554cc6ed-285e-4be2-9587-2e118a4616c8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:00.733668 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-554cc6ed-285e-4be2-9587-2e118a4616c8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:00.787355 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-554cc6ed-285e-4be2-9587-2e118a4616c8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:00.788264 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-554cc6ed-285e-4be2-9587-2e118a4616c8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:00.788884 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-554cc6ed-285e-4be2-9587-2e118a4616c8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lazy-loading 'fault' on Instance uuid a0707826-af06-4e43-8b88-8243dd68c7be {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:36:00.833352 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-554cc6ed-285e-4be2-9587-2e118a4616c8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:00.842342 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-554cc6ed-285e-4be2-9587-2e118a4616c8 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be" status: 200 len: 1332 microversion: 2.1 time: 0.137439 May 19 06:36:00.844692 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 279/557] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:00 2022] GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be => generated 1332 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:36:01.375752 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-674fce23-78dd-48fa-8a44-243bca0d0f75 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:01.376497 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-674fce23-78dd-48fa-8a44-243bca0d0f75 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:01.384142 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-674fce23-78dd-48fa-8a44-243bca0d0f75 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:01.384590 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-674fce23-78dd-48fa-8a44-243bca0d0f75 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:01.385482 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-674fce23-78dd-48fa-8a44-243bca0d0f75 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:01.385915 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-674fce23-78dd-48fa-8a44-243bca0d0f75 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:01.511555 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-674fce23-78dd-48fa-8a44-243bca0d0f75 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:01.524079 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-674fce23-78dd-48fa-8a44-243bca0d0f75 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635" status: 200 len: 1295 microversion: 2.1 time: 0.153259 May 19 06:36:01.525375 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 279/558] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:01 2022] GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635 => generated 1295 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:36:01.863111 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3d6376fa-0762-44eb-8b5d-a390fd4cd72b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:01.863832 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3d6376fa-0762-44eb-8b5d-a390fd4cd72b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: a0707826-af06-4e43-8b88-8243dd68c7be] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:01.876062 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3d6376fa-0762-44eb-8b5d-a390fd4cd72b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:01.876895 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3d6376fa-0762-44eb-8b5d-a390fd4cd72b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:01.878667 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3d6376fa-0762-44eb-8b5d-a390fd4cd72b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:01.885124 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3d6376fa-0762-44eb-8b5d-a390fd4cd72b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:01.904862 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-3d6376fa-0762-44eb-8b5d-a390fd4cd72b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] HTTP exception thrown: Instance a0707826-af06-4e43-8b88-8243dd68c7be could not be found. May 19 06:36:01.907028 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3d6376fa-0762-44eb-8b5d-a390fd4cd72b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Request method failure captured: May 19 06:36:01.907028 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be HTTP/1.1 May 19 06:36:01.907028 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept: application/json May 19 06:36:01.907028 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity May 19 06:36:01.907028 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Connection: close May 19 06:36:01.907028 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Length: 0 May 19 06:36:01.907028 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Type: application/json May 19 06:36:01.907028 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Host: 10.222.0.65 May 19 06:36:01.907028 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None May 19 06:36:01.907028 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 May 19 06:36:01.907028 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiheQpEYHNc-bqZDbTw7Fp3ihyV0ldXUTzVqdWql59X0rABgHWrMJ_mmqGdwFukt62XCeg2LJEaWYizlEXJ-MFBwGucN9hE2YUn-VSsy8oJQ2x49K6gk4QQGlP2u7BGs_KXICLfWCW8W72y7YMhrOqThFt82dOSFW0U-RORzkOxIAljYo May 19 06:36:01.907028 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Id: None May 19 06:36:01.907028 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Name: None May 19 06:36:01.907028 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed May 19 06:36:01.907028 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True May 19 06:36:01.907028 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default May 19 06:36:01.907028 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default May 19 06:36:01.907028 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Id: adbcff8654844c22a906a2e91ebca3bb May 19 06:36:01.907028 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-AttachVolumeNegativeTest-624051308 May 19 06:36:01.907028 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Role: reader,member May 19 06:36:01.907028 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Roles: reader,member May 19 06:36:01.916698 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_adbcff8654844c22a906a2e91ebca3bb", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:36:01.916698 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-AttachVolumeNegativeTest-624051308 May 19 06:36:01.916698 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Id: adbcff8654844c22a906a2e91ebca3bb May 19 06:36:01.916698 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-624051308 May 19 06:36:01.916698 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User: tempest-AttachVolumeNegativeTest-624051308-project May 19 06:36:01.916698 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default May 19 06:36:01.916698 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default May 19 06:36:01.916698 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Id: cb2bf8531dfe42b29b0b632b39d49625 May 19 06:36:01.916698 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-AttachVolumeNegativeTest-624051308-project May 19 06:36:01.916698 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: method: > May 19 06:36:01.916698 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: exception: Instance a0707826-af06-4e43-8b88-8243dd68c7be could not be found. May 19 06:36:01.916698 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: action_args: {'id': 'a0707826-af06-4e43-8b88-8243dd68c7be'} May 19 06:36:01.921050 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:36:01.921050 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:36:01.921050 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:36:01.921050 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:36:01.921050 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:36:01.921050 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:36:01.921050 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:36:01.921050 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:36:01.921050 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:36:01.921050 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:36:01.921050 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0707826-af06-4e43-8b88-8243dd68c7be could not be found. May 19 06:36:01.921050 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:36:01.921050 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:36:01.921050 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:36:01.921050 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:36:01.921050 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:36:01.921050 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:36:01.921050 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:36:01.921050 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:36:01.921050 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:36:01.923797 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:36:01.923797 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:36:01.923797 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:36:01.923797 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:36:01.923797 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:36:01.923797 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:36:01.923797 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:36:01.923797 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0707826-af06-4e43-8b88-8243dd68c7be could not be found. May 19 06:36:01.923797 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:36:01.923797 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:36:01.923797 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:36:01.923797 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:36:01.923797 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:36:01.923797 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:36:01.923797 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:36:01.923797 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:36:01.923797 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0707826-af06-4e43-8b88-8243dd68c7be could not be found. May 19 06:36:01.923797 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:36:01.925723 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3d6376fa-0762-44eb-8b5d-a390fd4cd72b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Returning 404 to user: Instance a0707826-af06-4e43-8b88-8243dd68c7be could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:36:01.925723 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3d6376fa-0762-44eb-8b5d-a390fd4cd72b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be" status: 404 len: 111 microversion: 2.1 time: 0.050086 May 19 06:36:01.925723 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 280/559] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:01 2022] GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 06:36:01.926137 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5e43a062-00ef-4e68-8025-3446a1691b91 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '.version_select at 0x7f9aeb4a48b0>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:01.947960 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5e43a062-00ef-4e68-8025-3446a1691b91 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1587867947" status: 202 len: 0 microversion: 2.1 time: 0.031208 May 19 06:36:01.948545 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 280/560] 10.222.0.65 () {58 vars in 1220 bytes} [Thu May 19 06:36:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1587867947 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 06:36:02.548584 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3500f018-608a-41c3-ac17-3cd2c39b1b09 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:02.549609 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3500f018-608a-41c3-ac17-3cd2c39b1b09 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:02.556117 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3500f018-608a-41c3-ac17-3cd2c39b1b09 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:02.556796 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3500f018-608a-41c3-ac17-3cd2c39b1b09 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:02.557799 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3500f018-608a-41c3-ac17-3cd2c39b1b09 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:02.558227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3500f018-608a-41c3-ac17-3cd2c39b1b09 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:02.823561 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3500f018-608a-41c3-ac17-3cd2c39b1b09 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:02.831917 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3500f018-608a-41c3-ac17-3cd2c39b1b09 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635" status: 200 len: 1362 microversion: 2.1 time: 0.287229 May 19 06:36:02.832514 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 281/561] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:02 2022] GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635 => generated 1362 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:36:02.834339 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-2fdc62e9-b5a8-4a66-acc1-d5990e629af4 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Action: 'create', calling method: .version_select at 0x7f9aeb4a41f0>, body: {"keypair": {"name": "tempest-keypair-1838394954", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOQIVmxtmNsBJwaGh3ZNbvLH6q0IIMcNrMHvL58n0Tfi/OYSWrXqZ6r8F7Ce26w3ItKhsihySENamJ4QZpFJgL+sy2oK7RRU7nHhaMlxp8pLd9O3XspAdhWT6cjZulU1w=="}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:36:02.855426 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-2fdc62e9-b5a8-4a66-acc1-d5990e629af4 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Getting quotas for project adbcff8654844c22a906a2e91ebca3bb. Resources: {'key_pairs'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:36:02.861440 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-2fdc62e9-b5a8-4a66-acc1-d5990e629af4 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Getting quotas for user cb2bf8531dfe42b29b0b632b39d49625 and project adbcff8654844c22a906a2e91ebca3bb. Resources: {'key_pairs'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:36:02.897048 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-6d846236-a5fc-474f-a826-566a019ff59d req-4fd9352e-a360-4e0f-bd6e-991aa29bcd03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80bd40e8-3416-4b6e-8655-40e57d12d635", "tag": "bb314e3e-a3eb-48a6-826d-79726548db0b"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:36:02.905112 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-2fdc62e9-b5a8-4a66-acc1-d5990e629af4 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.074125 May 19 06:36:02.908113 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 281/562] 10.222.0.65 () {60 vars in 1158 bytes} [Thu May 19 06:36:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:36:02.910549 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-6d846236-a5fc-474f-a826-566a019ff59d req-4fd9352e-a360-4e0f-bd6e-991aa29bcd03 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:02.911004 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-6d846236-a5fc-474f-a826-566a019ff59d req-4fd9352e-a360-4e0f-bd6e-991aa29bcd03 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:02.923114 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-6d846236-a5fc-474f-a826-566a019ff59d req-4fd9352e-a360-4e0f-bd6e-991aa29bcd03 service nova] Creating event network-changed:bb314e3e-a3eb-48a6-826d-79726548db0b for instance 80bd40e8-3416-4b6e-8655-40e57d12d635 on hv-cinder-83699 May 19 06:36:02.940184 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-6d846236-a5fc-474f-a826-566a019ff59d req-4fd9352e-a360-4e0f-bd6e-991aa29bcd03 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046784 May 19 06:36:02.940803 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 282/563] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:36:03.849625 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-73d3d0db-6dd0-42a3-b65e-ae7ce4be72a9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:03.850204 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-73d3d0db-6dd0-42a3-b65e-ae7ce4be72a9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:03.857866 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-73d3d0db-6dd0-42a3-b65e-ae7ce4be72a9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:03.857866 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-73d3d0db-6dd0-42a3-b65e-ae7ce4be72a9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:03.858552 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-73d3d0db-6dd0-42a3-b65e-ae7ce4be72a9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:03.858983 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-73d3d0db-6dd0-42a3-b65e-ae7ce4be72a9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:04.006216 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-73d3d0db-6dd0-42a3-b65e-ae7ce4be72a9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:04.015075 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-73d3d0db-6dd0-42a3-b65e-ae7ce4be72a9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635" status: 200 len: 1362 microversion: 2.1 time: 0.169456 May 19 06:36:04.015668 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 282/564] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:03 2022] GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:36:04.613502 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9484eb7c-d3d7-4f80-be85-843960cb58b1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1970815213", "imageRef": "27959167-098e-44c5-ba0a-e9fb8054c377", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ba03612d-d3e3-499d-b899-41fd0fc8db5e"}], "security_groups": [{"name": "tempest-securitygroup--971094448"}], "key_name": "tempest-keypair-1838394954", "user_data": "}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:36:04.718831 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.network.neutron [None req-9484eb7c-d3d7-4f80-be85-843960cb58b1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] validate_networks() for [('ba03612d-d3e3-499d-b899-41fd0fc8db5e', None, None, None, None, None)] {{(pid=117712) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 06:36:05.033257 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-bbb8a4ca-40ae-440c-89e7-3c3ba40af313 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:05.033892 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-bbb8a4ca-40ae-440c-89e7-3c3ba40af313 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:05.042539 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bbb8a4ca-40ae-440c-89e7-3c3ba40af313 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:05.043163 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bbb8a4ca-40ae-440c-89e7-3c3ba40af313 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:05.044093 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bbb8a4ca-40ae-440c-89e7-3c3ba40af313 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:05.045008 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bbb8a4ca-40ae-440c-89e7-3c3ba40af313 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:05.135977 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-9484eb7c-d3d7-4f80-be85-843960cb58b1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Flavor limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 06:36:05.136572 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-9484eb7c-d3d7-4f80-be85-843960cb58b1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Image limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 06:36:05.137494 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-9484eb7c-d3d7-4f80-be85-843960cb58b1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Flavor pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 06:36:05.138251 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-9484eb7c-d3d7-4f80-be85-843960cb58b1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Image pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 06:36:05.139202 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-9484eb7c-d3d7-4f80-be85-843960cb58b1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 06:36:05.151285 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9484eb7c-d3d7-4f80-be85-843960cb58b1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:05.151988 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9484eb7c-d3d7-4f80-be85-843960cb58b1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:05.152800 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9484eb7c-d3d7-4f80-be85-843960cb58b1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:05.153234 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9484eb7c-d3d7-4f80-be85-843960cb58b1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:05.171829 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-9484eb7c-d3d7-4f80-be85-843960cb58b1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Getting quotas for project adbcff8654844c22a906a2e91ebca3bb. Resources: {'ram', 'cores', 'instances'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:36:05.176489 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-9484eb7c-d3d7-4f80-be85-843960cb58b1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Getting quotas for user cb2bf8531dfe42b29b0b632b39d49625 and project adbcff8654844c22a906a2e91ebca3bb. Resources: {'ram', 'cores', 'instances'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:36:05.192131 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9484eb7c-d3d7-4f80-be85-843960cb58b1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Going to run 1 instances... {{(pid=117712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 06:36:05.196290 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9484eb7c-d3d7-4f80-be85-843960cb58b1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 747b4d4e-1bee-499b-bef9-380ab08e3594] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27959167-098e-44c5-ba0a-e9fb8054c377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 06:36:05.233408 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-bbb8a4ca-40ae-440c-89e7-3c3ba40af313 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:05.245457 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-bbb8a4ca-40ae-440c-89e7-3c3ba40af313 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635" status: 200 len: 1362 microversion: 2.1 time: 0.216238 May 19 06:36:05.246546 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 283/565] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:05 2022] GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:36:05.262562 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9484eb7c-d3d7-4f80-be85-843960cb58b1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.654053 May 19 06:36:05.263879 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 283/566] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 06:36:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 06:36:05.275885 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-9227e60a-342c-45e6-baa8-9dd634a42d88 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:05.276907 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-9227e60a-342c-45e6-baa8-9dd634a42d88 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 747b4d4e-1bee-499b-bef9-380ab08e3594] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:05.365242 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9227e60a-342c-45e6-baa8-9dd634a42d88 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:05.375115 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-9227e60a-342c-45e6-baa8-9dd634a42d88 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594" status: 200 len: 1242 microversion: 2.1 time: 0.103951 May 19 06:36:05.375834 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 284/567] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:05 2022] GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594 => generated 1242 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:36:06.264849 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7b5999aa-0efe-4ba1-8399-d4c873ff17a7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:06.265652 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7b5999aa-0efe-4ba1-8399-d4c873ff17a7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:06.273216 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7b5999aa-0efe-4ba1-8399-d4c873ff17a7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:06.273705 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7b5999aa-0efe-4ba1-8399-d4c873ff17a7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:06.274494 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7b5999aa-0efe-4ba1-8399-d4c873ff17a7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:06.274933 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7b5999aa-0efe-4ba1-8399-d4c873ff17a7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:06.403639 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e912e966-9abe-489e-a5c3-c1903b6447a6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:06.406252 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e912e966-9abe-489e-a5c3-c1903b6447a6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 747b4d4e-1bee-499b-bef9-380ab08e3594] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:06.416650 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=5 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:36:06.418751 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e912e966-9abe-489e-a5c3-c1903b6447a6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:06.420296 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e912e966-9abe-489e-a5c3-c1903b6447a6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:06.421468 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e912e966-9abe-489e-a5c3-c1903b6447a6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:06.422247 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e912e966-9abe-489e-a5c3-c1903b6447a6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:06.450312 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7b5999aa-0efe-4ba1-8399-d4c873ff17a7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:06.461020 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7b5999aa-0efe-4ba1-8399-d4c873ff17a7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635" status: 200 len: 1362 microversion: 2.1 time: 0.201138 May 19 06:36:06.464516 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 284/568] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:06 2022] GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635 => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:36:06.576318 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e912e966-9abe-489e-a5c3-c1903b6447a6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:06.587377 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e912e966-9abe-489e-a5c3-c1903b6447a6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594" status: 200 len: 1302 microversion: 2.1 time: 0.189787 May 19 06:36:06.588453 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 285/569] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:06 2022] GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594 => generated 1302 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:36:07.489981 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9ee2c30b-0176-43b2-b200-f224840d55c0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:07.490847 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9ee2c30b-0176-43b2-b200-f224840d55c0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:07.498365 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9ee2c30b-0176-43b2-b200-f224840d55c0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:07.499058 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9ee2c30b-0176-43b2-b200-f224840d55c0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:07.499923 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9ee2c30b-0176-43b2-b200-f224840d55c0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:07.500432 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9ee2c30b-0176-43b2-b200-f224840d55c0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:07.684513 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9ee2c30b-0176-43b2-b200-f224840d55c0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:07.696516 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9ee2c30b-0176-43b2-b200-f224840d55c0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635" status: 200 len: 1362 microversion: 2.1 time: 0.212057 May 19 06:36:07.697118 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 285/570] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:07 2022] GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:36:07.697886 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-385bbfe3-e4d7-4f92-8f2b-88201fddb42b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:07.698523 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-385bbfe3-e4d7-4f92-8f2b-88201fddb42b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 747b4d4e-1bee-499b-bef9-380ab08e3594] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:07.706652 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-385bbfe3-e4d7-4f92-8f2b-88201fddb42b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:07.707657 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-385bbfe3-e4d7-4f92-8f2b-88201fddb42b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:07.708642 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-385bbfe3-e4d7-4f92-8f2b-88201fddb42b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:07.709485 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-385bbfe3-e4d7-4f92-8f2b-88201fddb42b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:07.952856 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-385bbfe3-e4d7-4f92-8f2b-88201fddb42b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:07.963264 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-385bbfe3-e4d7-4f92-8f2b-88201fddb42b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594" status: 200 len: 1367 microversion: 2.1 time: 0.357785 May 19 06:36:07.964560 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 286/571] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:07 2022] GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594 => generated 1367 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:36:08.020527 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-aeabb0f3-9335-4fc5-91ad-529588a436af req-8bdef040-fdcc-407f-acbe-a21fc7c017ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80bd40e8-3416-4b6e-8655-40e57d12d635", "name": "network-vif-plugged", "status": "completed", "tag": "bb314e3e-a3eb-48a6-826d-79726548db0b"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:36:08.035225 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-aeabb0f3-9335-4fc5-91ad-529588a436af req-8bdef040-fdcc-407f-acbe-a21fc7c017ae service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:08.036102 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-aeabb0f3-9335-4fc5-91ad-529588a436af req-8bdef040-fdcc-407f-acbe-a21fc7c017ae service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:08.055090 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-aeabb0f3-9335-4fc5-91ad-529588a436af req-8bdef040-fdcc-407f-acbe-a21fc7c017ae service nova] Creating event network-vif-plugged:bb314e3e-a3eb-48a6-826d-79726548db0b for instance 80bd40e8-3416-4b6e-8655-40e57d12d635 on hv-cinder-83699 May 19 06:36:08.063715 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-aeabb0f3-9335-4fc5-91ad-529588a436af req-8bdef040-fdcc-407f-acbe-a21fc7c017ae service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048079 May 19 06:36:08.064725 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 286/572] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:36:08.595071 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-618bf99a-b671-4025-9d28-274f7191d7ed req-f40bda88-5fea-4472-a024-cdc85618379d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "747b4d4e-1bee-499b-bef9-380ab08e3594", "tag": "b7db8c94-9859-474d-a448-c4072b873d7e"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:36:08.608154 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-618bf99a-b671-4025-9d28-274f7191d7ed req-f40bda88-5fea-4472-a024-cdc85618379d service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:08.608933 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-618bf99a-b671-4025-9d28-274f7191d7ed req-f40bda88-5fea-4472-a024-cdc85618379d service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:08.630624 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-618bf99a-b671-4025-9d28-274f7191d7ed req-f40bda88-5fea-4472-a024-cdc85618379d service nova] Creating event network-changed:b7db8c94-9859-474d-a448-c4072b873d7e for instance 747b4d4e-1bee-499b-bef9-380ab08e3594 on hv-cinder-83699 May 19 06:36:08.639965 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-618bf99a-b671-4025-9d28-274f7191d7ed req-f40bda88-5fea-4472-a024-cdc85618379d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148949 May 19 06:36:08.641019 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 287/573] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:36:08.722758 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c101ef90-ef1c-4b37-83e3-30a624a613c9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:08.723594 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c101ef90-ef1c-4b37-83e3-30a624a613c9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:08.732861 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c101ef90-ef1c-4b37-83e3-30a624a613c9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:08.733789 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c101ef90-ef1c-4b37-83e3-30a624a613c9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:08.735383 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c101ef90-ef1c-4b37-83e3-30a624a613c9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:08.736075 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c101ef90-ef1c-4b37-83e3-30a624a613c9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:08.917144 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c101ef90-ef1c-4b37-83e3-30a624a613c9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:08.925443 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c101ef90-ef1c-4b37-83e3-30a624a613c9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635" status: 200 len: 1362 microversion: 2.1 time: 0.207640 May 19 06:36:08.926034 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 287/574] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:08 2022] GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:36:08.985472 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:36:08.989939 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5cb6c599-8677-44b5-9811-5243c1a2ea03 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:08.990654 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5cb6c599-8677-44b5-9811-5243c1a2ea03 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 747b4d4e-1bee-499b-bef9-380ab08e3594] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:08.997430 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5cb6c599-8677-44b5-9811-5243c1a2ea03 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:08.997866 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5cb6c599-8677-44b5-9811-5243c1a2ea03 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:08.998639 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5cb6c599-8677-44b5-9811-5243c1a2ea03 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:08.999074 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5cb6c599-8677-44b5-9811-5243c1a2ea03 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:09.161199 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5cb6c599-8677-44b5-9811-5243c1a2ea03 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:09.171058 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5cb6c599-8677-44b5-9811-5243c1a2ea03 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594" status: 200 len: 1367 microversion: 2.1 time: 0.186422 May 19 06:36:09.171661 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 288/575] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:08 2022] GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:36:10.008528 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f9ededd6-2dbc-4412-b707-3df40e7c531d tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:10.009136 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f9ededd6-2dbc-4412-b707-3df40e7c531d tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:10.016145 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f9ededd6-2dbc-4412-b707-3df40e7c531d tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:10.016585 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f9ededd6-2dbc-4412-b707-3df40e7c531d tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:10.017415 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f9ededd6-2dbc-4412-b707-3df40e7c531d tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:10.017843 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f9ededd6-2dbc-4412-b707-3df40e7c531d tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:10.193107 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f14748f1-d695-4f47-81d1-87a422599ce3 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:10.194298 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f14748f1-d695-4f47-81d1-87a422599ce3 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 747b4d4e-1bee-499b-bef9-380ab08e3594] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:10.197891 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f9ededd6-2dbc-4412-b707-3df40e7c531d tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:10.202764 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f14748f1-d695-4f47-81d1-87a422599ce3 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:10.203588 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f14748f1-d695-4f47-81d1-87a422599ce3 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:10.204499 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f14748f1-d695-4f47-81d1-87a422599ce3 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:10.205139 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f14748f1-d695-4f47-81d1-87a422599ce3 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:10.208082 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f9ededd6-2dbc-4412-b707-3df40e7c531d tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635" status: 200 len: 1548 microversion: 2.1 time: 0.268875 May 19 06:36:10.208673 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 288/576] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:09 2022] GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635 => generated 1548 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:36:10.239132 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a6bfc05e-7c77-45f6-826b-36644b8c60c0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:10.239903 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a6bfc05e-7c77-45f6-826b-36644b8c60c0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:10.250971 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a6bfc05e-7c77-45f6-826b-36644b8c60c0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:10.251765 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a6bfc05e-7c77-45f6-826b-36644b8c60c0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:10.253122 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a6bfc05e-7c77-45f6-826b-36644b8c60c0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:10.253938 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a6bfc05e-7c77-45f6-826b-36644b8c60c0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:10.389861 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a6bfc05e-7c77-45f6-826b-36644b8c60c0 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.158708 May 19 06:36:10.391076 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 289/577] 10.222.0.65 () {58 vars in 1274 bytes} [Thu May 19 06:36:10 2022] GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635/os-interface => generated 284 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:36:10.775331 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f14748f1-d695-4f47-81d1-87a422599ce3 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:10.791324 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f14748f1-d695-4f47-81d1-87a422599ce3 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594" status: 200 len: 1367 microversion: 2.1 time: 0.606120 May 19 06:36:10.792357 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 289/578] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:10 2022] GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594 => generated 1367 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:36:11.544854 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-5cd18740-b06e-45ad-b948-bbb0dc55e676 req-a624c678-0576-4258-ba1a-9ef58ca45288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80bd40e8-3416-4b6e-8655-40e57d12d635", "tag": "bb314e3e-a3eb-48a6-826d-79726548db0b"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:36:11.556591 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-5cd18740-b06e-45ad-b948-bbb0dc55e676 req-a624c678-0576-4258-ba1a-9ef58ca45288 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:11.557439 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-5cd18740-b06e-45ad-b948-bbb0dc55e676 req-a624c678-0576-4258-ba1a-9ef58ca45288 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:11.578363 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-5cd18740-b06e-45ad-b948-bbb0dc55e676 req-a624c678-0576-4258-ba1a-9ef58ca45288 service nova] Creating event network-changed:bb314e3e-a3eb-48a6-826d-79726548db0b for instance 80bd40e8-3416-4b6e-8655-40e57d12d635 on hv-cinder-83699 May 19 06:36:11.584437 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-5cd18740-b06e-45ad-b948-bbb0dc55e676 req-a624c678-0576-4258-ba1a-9ef58ca45288 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044915 May 19 06:36:11.585654 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 290/579] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:36:11.819614 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c42ae2a4-3b0f-40bc-b959-ccf3f6ad35a6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:11.820655 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c42ae2a4-3b0f-40bc-b959-ccf3f6ad35a6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 747b4d4e-1bee-499b-bef9-380ab08e3594] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:11.830724 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c42ae2a4-3b0f-40bc-b959-ccf3f6ad35a6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:11.831378 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c42ae2a4-3b0f-40bc-b959-ccf3f6ad35a6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:11.832350 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c42ae2a4-3b0f-40bc-b959-ccf3f6ad35a6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:11.833031 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c42ae2a4-3b0f-40bc-b959-ccf3f6ad35a6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:12.088917 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c42ae2a4-3b0f-40bc-b959-ccf3f6ad35a6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:12.098207 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c42ae2a4-3b0f-40bc-b959-ccf3f6ad35a6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594" status: 200 len: 1367 microversion: 2.1 time: 0.284166 May 19 06:36:12.099041 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 290/580] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:11 2022] GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594 => generated 1367 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:36:12.221093 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-5fa1cd21-9f5a-4eae-8e51-00d188ed99d5 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-816447210"}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:36:12.222851 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-5fa1cd21-9f5a-4eae-8e51-00d188ed99d5 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:12.236129 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5fa1cd21-9f5a-4eae-8e51-00d188ed99d5 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:12.236938 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5fa1cd21-9f5a-4eae-8e51-00d188ed99d5 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:12.238720 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5fa1cd21-9f5a-4eae-8e51-00d188ed99d5 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:12.239546 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5fa1cd21-9f5a-4eae-8e51-00d188ed99d5 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:12.425852 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.network.security_group_api [None req-5fa1cd21-9f5a-4eae-8e51-00d188ed99d5 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Removing security group 26b28be4-af3c-435b-8888-d8cf4b82bfcd from port aaf80320-db37-4f95-9ea4-8a1de850bf84 May 19 06:36:13.126580 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-11cc202e-0b5c-4511-a23b-429eb61ccf4d tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:13.127893 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-11cc202e-0b5c-4511-a23b-429eb61ccf4d tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 747b4d4e-1bee-499b-bef9-380ab08e3594] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:13.143131 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-11cc202e-0b5c-4511-a23b-429eb61ccf4d tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:13.149921 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-11cc202e-0b5c-4511-a23b-429eb61ccf4d tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:13.152091 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-11cc202e-0b5c-4511-a23b-429eb61ccf4d tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:13.152873 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-11cc202e-0b5c-4511-a23b-429eb61ccf4d tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:13.172576 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-5fa1cd21-9f5a-4eae-8e51-00d188ed99d5 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "POST /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a/action" status: 202 len: 0 microversion: 2.1 time: 0.961426 May 19 06:36:13.177182 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 291/581] 10.222.0.65 () {60 vars in 1277 bytes} [Thu May 19 06:36:12 2022] POST /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a/action => generated 0 bytes in 968 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 06:36:13.565104 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-11cc202e-0b5c-4511-a23b-429eb61ccf4d tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:13.574987 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-11cc202e-0b5c-4511-a23b-429eb61ccf4d tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594" status: 200 len: 1367 microversion: 2.1 time: 0.455498 May 19 06:36:13.577612 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 291/582] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:13 2022] GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594 => generated 1367 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:36:13.603742 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-406c19c9-d089-4390-a579-a9c5359da9dc req-0a901695-2286-44e3-a151-daeb5e90e590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "285cd5e6-76c3-491a-8b1d-23837478002a", "tag": "aaf80320-db37-4f95-9ea4-8a1de850bf84"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:36:13.617334 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-406c19c9-d089-4390-a579-a9c5359da9dc req-0a901695-2286-44e3-a151-daeb5e90e590 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:13.617995 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-406c19c9-d089-4390-a579-a9c5359da9dc req-0a901695-2286-44e3-a151-daeb5e90e590 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:13.646770 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-406c19c9-d089-4390-a579-a9c5359da9dc req-0a901695-2286-44e3-a151-daeb5e90e590 service nova] Creating event network-changed:aaf80320-db37-4f95-9ea4-8a1de850bf84 for instance 285cd5e6-76c3-491a-8b1d-23837478002a on hv-cinder-83699 May 19 06:36:13.655994 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-406c19c9-d089-4390-a579-a9c5359da9dc req-0a901695-2286-44e3-a151-daeb5e90e590 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056456 May 19 06:36:13.656946 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 292/583] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:36:14.593075 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f9aecea5-aab7-4372-ace4-276f9dc157c7 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:14.594040 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f9aecea5-aab7-4372-ace4-276f9dc157c7 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 747b4d4e-1bee-499b-bef9-380ab08e3594] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:14.600542 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f9aecea5-aab7-4372-ace4-276f9dc157c7 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:14.600985 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f9aecea5-aab7-4372-ace4-276f9dc157c7 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:14.602021 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f9aecea5-aab7-4372-ace4-276f9dc157c7 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:14.602457 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f9aecea5-aab7-4372-ace4-276f9dc157c7 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:14.677754 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-dedbfd07-48b0-4695-b8fe-0a076a759255 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:14.678342 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-dedbfd07-48b0-4695-b8fe-0a076a759255 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:14.687496 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dedbfd07-48b0-4695-b8fe-0a076a759255 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:14.688130 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dedbfd07-48b0-4695-b8fe-0a076a759255 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:14.689186 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dedbfd07-48b0-4695-b8fe-0a076a759255 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:14.689761 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dedbfd07-48b0-4695-b8fe-0a076a759255 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:14.778590 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f9aecea5-aab7-4372-ace4-276f9dc157c7 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:14.786337 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:36:14.787311 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f9aecea5-aab7-4372-ace4-276f9dc157c7 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594" status: 200 len: 1367 microversion: 2.1 time: 0.198796 May 19 06:36:14.793339 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 292/584] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:14 2022] GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:36:14.793567 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-dedbfd07-48b0-4695-b8fe-0a076a759255 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lazy-loading 'services' on Instance uuid 285cd5e6-76c3-491a-8b1d-23837478002a {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:36:14.884105 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-dedbfd07-48b0-4695-b8fe-0a076a759255 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "DELETE /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a/os-volume_attachments/fc6f2104-8f61-413f-9c2f-d2f122bf1bfa" status: 202 len: 0 microversion: 2.1 time: 0.210119 May 19 06:36:14.885387 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 293/585] 10.222.0.65 () {58 vars in 1415 bytes} [Thu May 19 06:36:14 2022] DELETE /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a/os-volume_attachments/fc6f2104-8f61-413f-9c2f-d2f122bf1bfa => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 06:36:14.896708 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-aba63d31-240d-45ba-a9b0-3b0a9856a897 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:14.902892 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-aba63d31-240d-45ba-a9b0-3b0a9856a897 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:14.915013 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-aba63d31-240d-45ba-a9b0-3b0a9856a897 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:14.917709 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-aba63d31-240d-45ba-a9b0-3b0a9856a897 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:14.919728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-aba63d31-240d-45ba-a9b0-3b0a9856a897 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:14.920359 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-aba63d31-240d-45ba-a9b0-3b0a9856a897 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:14.955527 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-aba63d31-240d-45ba-a9b0-3b0a9856a897 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063122 May 19 06:36:14.956576 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 293/586] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 06:36:14 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:36:15.726045 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-83f4fcec-fca8-4530-9f9f-dc87bcb3ebd4 req-e00aa39a-ee88-4568-bf2e-77b4891f1092 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "285cd5e6-76c3-491a-8b1d-23837478002a", "tag": "aaf80320-db37-4f95-9ea4-8a1de850bf84"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:36:15.730657 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:36:15.731422 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=8 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:36:15.739298 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:36:15.748523 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-83f4fcec-fca8-4530-9f9f-dc87bcb3ebd4 req-e00aa39a-ee88-4568-bf2e-77b4891f1092 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:15.748523 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-83f4fcec-fca8-4530-9f9f-dc87bcb3ebd4 req-e00aa39a-ee88-4568-bf2e-77b4891f1092 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:15.764498 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-83f4fcec-fca8-4530-9f9f-dc87bcb3ebd4 req-e00aa39a-ee88-4568-bf2e-77b4891f1092 service nova] Creating event network-changed:aaf80320-db37-4f95-9ea4-8a1de850bf84 for instance 285cd5e6-76c3-491a-8b1d-23837478002a on hv-cinder-83699 May 19 06:36:15.769785 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-83f4fcec-fca8-4530-9f9f-dc87bcb3ebd4 req-e00aa39a-ee88-4568-bf2e-77b4891f1092 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047976 May 19 06:36:15.770395 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 294/587] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:36:15.804177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ed868574-fa0e-406c-9d36-e3cc75ff4b33 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:15.804791 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ed868574-fa0e-406c-9d36-e3cc75ff4b33 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 747b4d4e-1bee-499b-bef9-380ab08e3594] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:15.806758 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=16 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:36:15.813339 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ed868574-fa0e-406c-9d36-e3cc75ff4b33 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:15.813928 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ed868574-fa0e-406c-9d36-e3cc75ff4b33 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:15.814711 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ed868574-fa0e-406c-9d36-e3cc75ff4b33 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:15.815142 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ed868574-fa0e-406c-9d36-e3cc75ff4b33 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:15.971790 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2e88d7ed-d249-42d3-ae0c-65d0a83d5dfb tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:15.972783 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-2e88d7ed-d249-42d3-ae0c-65d0a83d5dfb tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:15.980061 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2e88d7ed-d249-42d3-ae0c-65d0a83d5dfb tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:15.980799 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2e88d7ed-d249-42d3-ae0c-65d0a83d5dfb tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:15.981772 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2e88d7ed-d249-42d3-ae0c-65d0a83d5dfb tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:15.982400 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2e88d7ed-d249-42d3-ae0c-65d0a83d5dfb tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:16.016554 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2e88d7ed-d249-42d3-ae0c-65d0a83d5dfb tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049029 May 19 06:36:16.021969 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 295/588] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 06:36:15 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 06:36:16.027890 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-81ea9a47-c056-4f12-9bc2-67679bc0917a tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:16.028782 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-81ea9a47-c056-4f12-9bc2-67679bc0917a tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:16.035450 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-81ea9a47-c056-4f12-9bc2-67679bc0917a tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:16.036022 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-81ea9a47-c056-4f12-9bc2-67679bc0917a tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:16.037039 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-81ea9a47-c056-4f12-9bc2-67679bc0917a tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:16.037525 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-81ea9a47-c056-4f12-9bc2-67679bc0917a tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:16.090718 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ed868574-fa0e-406c-9d36-e3cc75ff4b33 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:16.101998 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ed868574-fa0e-406c-9d36-e3cc75ff4b33 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594" status: 200 len: 1367 microversion: 2.1 time: 0.301636 May 19 06:36:16.117262 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 294/589] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:15 2022] GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594 => generated 1367 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:36:16.124795 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-2b33bae7-81c0-4d11-8def-ae8911f0793a req-2333d35d-1fd2-46ef-bb0a-d9aa0b647125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "747b4d4e-1bee-499b-bef9-380ab08e3594", "name": "network-vif-plugged", "status": "completed", "tag": "b7db8c94-9859-474d-a448-c4072b873d7e"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:36:16.135769 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-2b33bae7-81c0-4d11-8def-ae8911f0793a req-2333d35d-1fd2-46ef-bb0a-d9aa0b647125 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:16.136776 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-2b33bae7-81c0-4d11-8def-ae8911f0793a req-2333d35d-1fd2-46ef-bb0a-d9aa0b647125 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:16.151921 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-2b33bae7-81c0-4d11-8def-ae8911f0793a req-2333d35d-1fd2-46ef-bb0a-d9aa0b647125 service nova] Creating event network-vif-plugged:b7db8c94-9859-474d-a448-c4072b873d7e for instance 747b4d4e-1bee-499b-bef9-380ab08e3594 on hv-cinder-83699 May 19 06:36:16.156012 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-81ea9a47-c056-4f12-9bc2-67679bc0917a tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] HTTP exception thrown: Instance 285cd5e6-76c3-491a-8b1d-23837478002a is not attached to volume fc6f2104-8f61-413f-9c2f-d2f122bf1bfa May 19 06:36:16.158251 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-2b33bae7-81c0-4d11-8def-ae8911f0793a req-2333d35d-1fd2-46ef-bb0a-d9aa0b647125 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038667 May 19 06:36:16.159175 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 295/590] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:36:16.175090 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-81ea9a47-c056-4f12-9bc2-67679bc0917a tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Request method failure captured: May 19 06:36:16.175090 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: request: DELETE /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a/os-volume_attachments/fc6f2104-8f61-413f-9c2f-d2f122bf1bfa HTTP/1.1 May 19 06:36:16.175090 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept: application/json May 19 06:36:16.175090 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity May 19 06:36:16.175090 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Connection: close May 19 06:36:16.175090 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Length: 0 May 19 06:36:16.175090 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Type: application/json May 19 06:36:16.175090 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Host: 10.222.0.65 May 19 06:36:16.175090 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None May 19 06:36:16.175090 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 May 19 06:36:16.175090 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiheS6bRGBqhXHOAZw9dCI_Rq6DZ2e2-36h-BzqgEczuhFrWKKDsT7Ngft9WryYDmAXZ79amYBuIZPBxjrGVWU1IptZaDJlW-KuqWTKI78LoQNwa0tnOgEQVaTkEuK1BIck7qeclo-RAzFkiIWHPpEObLFEQkbsvxF5kOewRzCIXARB5c May 19 06:36:16.175090 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Id: None May 19 06:36:16.175090 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Name: None May 19 06:36:16.175090 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed May 19 06:36:16.175090 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True May 19 06:36:16.175090 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default May 19 06:36:16.175090 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default May 19 06:36:16.175090 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Id: 14bd96bd91c44b888074b760e9834814 May 19 06:36:16.175090 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-TestMinimumBasicScenario-529562927 May 19 06:36:16.175090 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Role: reader,member May 19 06:36:16.175090 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Roles: reader,member May 19 06:36:16.176827 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/14bd96bd91c44b888074b760e9834814"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/14bd96bd91c44b888074b760e9834814"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/14bd96bd91c44b888074b760e9834814"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_14bd96bd91c44b888074b760e9834814", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:36:16.176827 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-TestMinimumBasicScenario-529562927 May 19 06:36:16.176827 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Id: 14bd96bd91c44b888074b760e9834814 May 19 06:36:16.176827 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-TestMinimumBasicScenario-529562927 May 19 06:36:16.176827 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User: tempest-TestMinimumBasicScenario-529562927-project May 19 06:36:16.176827 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default May 19 06:36:16.176827 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default May 19 06:36:16.176827 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Id: d4008c6bb57b4a91b2761fc87a1e9d2f May 19 06:36:16.176827 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-TestMinimumBasicScenario-529562927-project May 19 06:36:16.176827 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: method: > May 19 06:36:16.176827 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: exception: Instance 285cd5e6-76c3-491a-8b1d-23837478002a is not attached to volume fc6f2104-8f61-413f-9c2f-d2f122bf1bfa May 19 06:36:16.178716 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: action_args: {'server_id': '285cd5e6-76c3-491a-8b1d-23837478002a', 'id': 'fc6f2104-8f61-413f-9c2f-d2f122bf1bfa'} May 19 06:36:16.178716 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:36:16.178716 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:36:16.178716 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 19 06:36:16.178716 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 19 06:36:16.178716 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 06:36:16.178716 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 06:36:16.178716 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 19 06:36:16.178716 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 19 06:36:16.178716 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fc6f2104-8f61-413f-9c2f-d2f122bf1bfa. May 19 06:36:16.178716 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:36:16.178716 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:36:16.178716 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:36:16.178716 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:36:16.178716 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:36:16.178716 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:36:16.178716 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:36:16.178716 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:36:16.178716 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:36:16.179883 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:36:16.179883 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 19 06:36:16.179883 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 06:36:16.179883 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 285cd5e6-76c3-491a-8b1d-23837478002a is not attached to volume fc6f2104-8f61-413f-9c2f-d2f122bf1bfa May 19 06:36:16.179883 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:36:16.179883 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:36:16.179883 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:36:16.179883 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:36:16.179883 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:36:16.179883 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:36:16.179883 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:36:16.179883 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:36:16.179883 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 285cd5e6-76c3-491a-8b1d-23837478002a is not attached to volume fc6f2104-8f61-413f-9c2f-d2f122bf1bfa May 19 06:36:16.179883 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:36:16.179883 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-81ea9a47-c056-4f12-9bc2-67679bc0917a tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Returning 404 to user: Instance 285cd5e6-76c3-491a-8b1d-23837478002a is not attached to volume fc6f2104-8f61-413f-9c2f-d2f122bf1bfa {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:36:16.181226 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-81ea9a47-c056-4f12-9bc2-67679bc0917a tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "DELETE /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a/os-volume_attachments/fc6f2104-8f61-413f-9c2f-d2f122bf1bfa" status: 404 len: 154 microversion: 2.1 time: 0.145264 May 19 06:36:16.181226 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 296/591] 10.222.0.65 () {58 vars in 1415 bytes} [Thu May 19 06:36:16 2022] DELETE /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a/os-volume_attachments/fc6f2104-8f61-413f-9c2f-d2f122bf1bfa => generated 154 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:36:17.125877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-fba992a2-bd6d-4066-b430-80e1411eb0c1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:17.126567 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-fba992a2-bd6d-4066-b430-80e1411eb0c1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 747b4d4e-1bee-499b-bef9-380ab08e3594] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:17.132785 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fba992a2-bd6d-4066-b430-80e1411eb0c1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:17.133228 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fba992a2-bd6d-4066-b430-80e1411eb0c1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:17.134004 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fba992a2-bd6d-4066-b430-80e1411eb0c1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:17.134425 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fba992a2-bd6d-4066-b430-80e1411eb0c1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:17.268359 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-fba992a2-bd6d-4066-b430-80e1411eb0c1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:17.276060 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-fba992a2-bd6d-4066-b430-80e1411eb0c1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594" status: 200 len: 1367 microversion: 2.1 time: 0.154969 May 19 06:36:17.276900 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 296/592] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:17 2022] GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:36:17.321563 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f7a2a152-f2e4-4d8c-bdf7-40211eae8f1d tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:17.322154 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f7a2a152-f2e4-4d8c-bdf7-40211eae8f1d tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:17.329318 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f7a2a152-f2e4-4d8c-bdf7-40211eae8f1d tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:17.329766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f7a2a152-f2e4-4d8c-bdf7-40211eae8f1d tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:17.330535 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f7a2a152-f2e4-4d8c-bdf7-40211eae8f1d tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:17.330960 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f7a2a152-f2e4-4d8c-bdf7-40211eae8f1d tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:17.358295 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f7a2a152-f2e4-4d8c-bdf7-40211eae8f1d tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Going to try to terminate instance {{(pid=117712) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 06:36:17.438640 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f7a2a152-f2e4-4d8c-bdf7-40211eae8f1d tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "DELETE /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 204 len: 0 microversion: 2.1 time: 0.120627 May 19 06:36:17.439258 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 297/593] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 06:36:17 2022] DELETE /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 06:36:17.447954 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-dd84f360-f7d2-496c-bf9a-8f7c7a6de30e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:17.448611 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-dd84f360-f7d2-496c-bf9a-8f7c7a6de30e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:17.455139 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dd84f360-f7d2-496c-bf9a-8f7c7a6de30e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:17.455583 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dd84f360-f7d2-496c-bf9a-8f7c7a6de30e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:17.456329 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dd84f360-f7d2-496c-bf9a-8f7c7a6de30e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:17.456757 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dd84f360-f7d2-496c-bf9a-8f7c7a6de30e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:17.472290 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=100 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:36:17.594789 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-dd84f360-f7d2-496c-bf9a-8f7c7a6de30e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:17.602511 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-dd84f360-f7d2-496c-bf9a-8f7c7a6de30e tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1553 microversion: 2.1 time: 0.158500 May 19 06:36:17.603290 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 297/594] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:17 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:36:18.294827 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-77f88033-9143-4797-b2a0-b1b8103e87c5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:18.295561 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-77f88033-9143-4797-b2a0-b1b8103e87c5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 747b4d4e-1bee-499b-bef9-380ab08e3594] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:18.301636 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-77f88033-9143-4797-b2a0-b1b8103e87c5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:18.302086 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-77f88033-9143-4797-b2a0-b1b8103e87c5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:18.302886 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-77f88033-9143-4797-b2a0-b1b8103e87c5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:18.303317 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-77f88033-9143-4797-b2a0-b1b8103e87c5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:18.438398 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-77f88033-9143-4797-b2a0-b1b8103e87c5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:18.446038 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-77f88033-9143-4797-b2a0-b1b8103e87c5 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594" status: 200 len: 1367 microversion: 2.1 time: 0.156095 May 19 06:36:18.446609 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 298/595] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:18 2022] GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:36:18.619957 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-be0b6f1d-418e-425c-a485-1b7f739d6ea6 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:18.620566 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-be0b6f1d-418e-425c-a485-1b7f739d6ea6 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:18.627351 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-be0b6f1d-418e-425c-a485-1b7f739d6ea6 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:18.627803 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-be0b6f1d-418e-425c-a485-1b7f739d6ea6 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:18.628564 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-be0b6f1d-418e-425c-a485-1b7f739d6ea6 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:18.628997 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-be0b6f1d-418e-425c-a485-1b7f739d6ea6 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:18.767216 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-be0b6f1d-418e-425c-a485-1b7f739d6ea6 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:18.777070 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-be0b6f1d-418e-425c-a485-1b7f739d6ea6 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1553 microversion: 2.1 time: 0.160353 May 19 06:36:18.778123 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 298/596] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:18 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:36:19.029059 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-5321fd3b-dbdc-4aff-92b8-6be03a43835d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:19.029605 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-5321fd3b-dbdc-4aff-92b8-6be03a43835d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:19.036122 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5321fd3b-dbdc-4aff-92b8-6be03a43835d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:19.036572 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5321fd3b-dbdc-4aff-92b8-6be03a43835d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:19.037385 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5321fd3b-dbdc-4aff-92b8-6be03a43835d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:19.037822 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5321fd3b-dbdc-4aff-92b8-6be03a43835d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:19.127879 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-5321fd3b-dbdc-4aff-92b8-6be03a43835d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lazy-loading 'services' on Instance uuid 3e905065-4c72-403f-ba1f-3d56ec56b4f0 {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:36:19.208352 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-5321fd3b-dbdc-4aff-92b8-6be03a43835d tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0/os-volume_attachments/dc901c90-4dfe-43fb-b856-e29064abd557" status: 202 len: 0 microversion: 2.1 time: 0.184076 May 19 06:36:19.209037 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 299/597] 10.222.0.65 () {58 vars in 1415 bytes} [Thu May 19 06:36:19 2022] DELETE /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0/os-volume_attachments/dc901c90-4dfe-43fb-b856-e29064abd557 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 06:36:19.218191 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-961c1def-e241-46b5-b245-4310c7b402b7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:19.219210 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-961c1def-e241-46b5-b245-4310c7b402b7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:19.225935 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-961c1def-e241-46b5-b245-4310c7b402b7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:19.226636 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-961c1def-e241-46b5-b245-4310c7b402b7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:19.227800 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-961c1def-e241-46b5-b245-4310c7b402b7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:19.228333 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-961c1def-e241-46b5-b245-4310c7b402b7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:19.265438 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-961c1def-e241-46b5-b245-4310c7b402b7 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051535 May 19 06:36:19.266038 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 299/598] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 06:36:19 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:36:19.468915 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e7ab5528-5989-46c1-878c-f8eb1d235f41 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:19.470206 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e7ab5528-5989-46c1-878c-f8eb1d235f41 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 747b4d4e-1bee-499b-bef9-380ab08e3594] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:19.479071 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e7ab5528-5989-46c1-878c-f8eb1d235f41 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:19.479511 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e7ab5528-5989-46c1-878c-f8eb1d235f41 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:19.480284 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e7ab5528-5989-46c1-878c-f8eb1d235f41 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:19.480710 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e7ab5528-5989-46c1-878c-f8eb1d235f41 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:19.663029 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e7ab5528-5989-46c1-878c-f8eb1d235f41 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:19.671552 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e7ab5528-5989-46c1-878c-f8eb1d235f41 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594" status: 200 len: 1556 microversion: 2.1 time: 0.211240 May 19 06:36:19.672419 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 300/599] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:19 2022] GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594 => generated 1556 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:36:19.690508 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-97396b5a-5a2a-4d5a-ab1a-6d1ba50ca2e2 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:19.691672 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-97396b5a-5a2a-4d5a-ab1a-6d1ba50ca2e2 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 747b4d4e-1bee-499b-bef9-380ab08e3594] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:19.699727 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-97396b5a-5a2a-4d5a-ab1a-6d1ba50ca2e2 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:19.701177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-97396b5a-5a2a-4d5a-ab1a-6d1ba50ca2e2 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:19.702709 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-97396b5a-5a2a-4d5a-ab1a-6d1ba50ca2e2 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:19.703583 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-97396b5a-5a2a-4d5a-ab1a-6d1ba50ca2e2 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:19.796862 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-09acf2da-c039-49b2-90ee-920a13591699 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:19.797435 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-09acf2da-c039-49b2-90ee-920a13591699 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:19.804913 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-09acf2da-c039-49b2-90ee-920a13591699 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:19.805441 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-09acf2da-c039-49b2-90ee-920a13591699 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:19.806423 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-09acf2da-c039-49b2-90ee-920a13591699 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:19.806857 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-09acf2da-c039-49b2-90ee-920a13591699 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:19.823757 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-97396b5a-5a2a-4d5a-ab1a-6d1ba50ca2e2 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137089 May 19 06:36:19.831423 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 300/600] 10.222.0.65 () {58 vars in 1274 bytes} [Thu May 19 06:36:19 2022] GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:36:20.103086 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-09acf2da-c039-49b2-90ee-920a13591699 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4008c6bb57b4a91b2761fc87a1e9d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bd96bd91c44b888074b760e9834814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:20.112319 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-09acf2da-c039-49b2-90ee-920a13591699 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 200 len: 1553 microversion: 2.1 time: 0.320731 May 19 06:36:20.113514 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 301/601] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:19 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 1553 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:36:20.130758 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-9019278d-0640-4e21-bc99-9932a50bf761 req-a4a1a723-353a-499d-b231-1fa079058edb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "285cd5e6-76c3-491a-8b1d-23837478002a", "name": "network-vif-deleted", "tag": "aaf80320-db37-4f95-9ea4-8a1de850bf84"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:36:20.140543 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-9019278d-0640-4e21-bc99-9932a50bf761 req-a4a1a723-353a-499d-b231-1fa079058edb service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:20.140987 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-9019278d-0640-4e21-bc99-9932a50bf761 req-a4a1a723-353a-499d-b231-1fa079058edb service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:20.156524 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-9019278d-0640-4e21-bc99-9932a50bf761 req-a4a1a723-353a-499d-b231-1fa079058edb service nova] Creating event network-vif-deleted:aaf80320-db37-4f95-9ea4-8a1de850bf84 for instance 285cd5e6-76c3-491a-8b1d-23837478002a on hv-cinder-83699 May 19 06:36:20.163287 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-9019278d-0640-4e21-bc99-9932a50bf761 req-a4a1a723-353a-499d-b231-1fa079058edb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036215 May 19 06:36:20.163911 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 301/602] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:36:20.277968 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-407f5a65-4b70-4aca-82ab-253621754674 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:20.280560 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-407f5a65-4b70-4aca-82ab-253621754674 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:20.287325 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-407f5a65-4b70-4aca-82ab-253621754674 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:20.287869 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-407f5a65-4b70-4aca-82ab-253621754674 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:20.288749 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-407f5a65-4b70-4aca-82ab-253621754674 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:20.289258 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-407f5a65-4b70-4aca-82ab-253621754674 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:20.327032 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-407f5a65-4b70-4aca-82ab-253621754674 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052698 May 19 06:36:20.327668 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 302/603] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 06:36:20 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 06:36:20.415189 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0b33d343-69de-4891-977c-5bc49c98f189 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:20.416240 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0b33d343-69de-4891-977c-5bc49c98f189 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:20.429100 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0b33d343-69de-4891-977c-5bc49c98f189 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:20.437409 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0b33d343-69de-4891-977c-5bc49c98f189 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:20.439060 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0b33d343-69de-4891-977c-5bc49c98f189 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:20.439867 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0b33d343-69de-4891-977c-5bc49c98f189 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:20.470442 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0b33d343-69de-4891-977c-5bc49c98f189 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Going to try to terminate instance {{(pid=117711) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 06:36:20.587112 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0b33d343-69de-4891-977c-5bc49c98f189 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 204 len: 0 microversion: 2.1 time: 0.178645 May 19 06:36:20.589071 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 302/604] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 06:36:20 2022] DELETE /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 06:36:20.599030 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a0d2f90b-3c05-440d-a5c8-1dd4a3d2aeba tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:20.600417 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a0d2f90b-3c05-440d-a5c8-1dd4a3d2aeba tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:20.611309 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a0d2f90b-3c05-440d-a5c8-1dd4a3d2aeba tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:20.611749 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a0d2f90b-3c05-440d-a5c8-1dd4a3d2aeba tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:20.612781 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a0d2f90b-3c05-440d-a5c8-1dd4a3d2aeba tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:20.613214 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a0d2f90b-3c05-440d-a5c8-1dd4a3d2aeba tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:20.882965 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a0d2f90b-3c05-440d-a5c8-1dd4a3d2aeba tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:20.891949 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a0d2f90b-3c05-440d-a5c8-1dd4a3d2aeba tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1687 microversion: 2.1 time: 0.297703 May 19 06:36:20.892542 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 303/605] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:20 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1687 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:36:21.134055 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-85d3502e-053c-4505-a436-e2294ef07df7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:21.135307 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-85d3502e-053c-4505-a436-e2294ef07df7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] [instance: 285cd5e6-76c3-491a-8b1d-23837478002a] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:21.145143 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-85d3502e-053c-4505-a436-e2294ef07df7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:21.145888 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-85d3502e-053c-4505-a436-e2294ef07df7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:21.146897 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-85d3502e-053c-4505-a436-e2294ef07df7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:21.147596 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-85d3502e-053c-4505-a436-e2294ef07df7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:21.167585 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-85d3502e-053c-4505-a436-e2294ef07df7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] HTTP exception thrown: Instance 285cd5e6-76c3-491a-8b1d-23837478002a could not be found. May 19 06:36:21.170761 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-85d3502e-053c-4505-a436-e2294ef07df7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Request method failure captured: May 19 06:36:21.170761 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a HTTP/1.1 May 19 06:36:21.170761 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:36:21.170761 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:36:21.170761 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:36:21.170761 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 0 May 19 06:36:21.170761 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:36:21.170761 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:36:21.170761 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:36:21.170761 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:36:21.170761 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheS6bRGBqhXHOAZw9dCI_Rq6DZ2e2-36h-BzqgEczuhFrWKKDsT7Ngft9WryYDmAXZ79amYBuIZPBxjrGVWU1IptZaDJlW-KuqWTKI78LoQNwa0tnOgEQVaTkEuK1BIck7qeclo-RAzFkiIWHPpEObLFEQkbsvxF5kOewRzCIXARB5c May 19 06:36:21.170761 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:36:21.170761 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:36:21.170761 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:36:21.170761 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:36:21.170761 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:36:21.170761 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:36:21.170761 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: 14bd96bd91c44b888074b760e9834814 May 19 06:36:21.170761 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-TestMinimumBasicScenario-529562927 May 19 06:36:21.170761 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:36:21.170761 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:36:21.173573 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/14bd96bd91c44b888074b760e9834814"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/14bd96bd91c44b888074b760e9834814"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/14bd96bd91c44b888074b760e9834814"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_14bd96bd91c44b888074b760e9834814", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:36:21.173573 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-TestMinimumBasicScenario-529562927 May 19 06:36:21.173573 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: 14bd96bd91c44b888074b760e9834814 May 19 06:36:21.173573 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-TestMinimumBasicScenario-529562927 May 19 06:36:21.173573 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-TestMinimumBasicScenario-529562927-project May 19 06:36:21.173573 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:36:21.173573 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:36:21.173573 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: d4008c6bb57b4a91b2761fc87a1e9d2f May 19 06:36:21.173573 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-TestMinimumBasicScenario-529562927-project May 19 06:36:21.173573 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: > May 19 06:36:21.173573 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Instance 285cd5e6-76c3-491a-8b1d-23837478002a could not be found. May 19 06:36:21.173573 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'id': '285cd5e6-76c3-491a-8b1d-23837478002a'} May 19 06:36:21.175005 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:36:21.175005 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:36:21.175005 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:36:21.175005 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:36:21.175005 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:36:21.175005 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:36:21.175005 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:36:21.175005 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:36:21.175005 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:36:21.175005 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:36:21.175005 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 285cd5e6-76c3-491a-8b1d-23837478002a could not be found. May 19 06:36:21.175005 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:36:21.175005 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:36:21.175005 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:36:21.175005 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:36:21.175005 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:36:21.175005 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:36:21.175005 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:36:21.175005 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:36:21.175005 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:36:21.178422 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:36:21.178422 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:36:21.178422 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:36:21.178422 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:36:21.178422 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:36:21.178422 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:36:21.178422 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:36:21.178422 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 285cd5e6-76c3-491a-8b1d-23837478002a could not be found. May 19 06:36:21.178422 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:36:21.178422 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:36:21.178422 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:36:21.178422 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:36:21.178422 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:36:21.178422 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:36:21.178422 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:36:21.178422 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:36:21.178422 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 285cd5e6-76c3-491a-8b1d-23837478002a could not be found. May 19 06:36:21.178422 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:36:21.186289 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-85d3502e-053c-4505-a436-e2294ef07df7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Returning 404 to user: Instance 285cd5e6-76c3-491a-8b1d-23837478002a could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:36:21.186289 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-85d3502e-053c-4505-a436-e2294ef07df7 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a" status: 404 len: 111 microversion: 2.1 time: 0.047132 May 19 06:36:21.186289 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 303/606] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:21 2022] GET /compute/v2.1/servers/285cd5e6-76c3-491a-8b1d-23837478002a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:36:21.191185 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-635af991-20b4-426a-9357-052461c434b6 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] Calling method '.version_select at 0x7f9aeac0faf0>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:21.197439 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-27728509-e2d6-4993-9ca5-7e524d019041 req-3bea8d2c-db4b-49bc-add3-96e0d1fc0bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "747b4d4e-1bee-499b-bef9-380ab08e3594", "tag": "b7db8c94-9859-474d-a448-c4072b873d7e"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:36:21.212308 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-27728509-e2d6-4993-9ca5-7e524d019041 req-3bea8d2c-db4b-49bc-add3-96e0d1fc0bc4 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:21.213511 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-27728509-e2d6-4993-9ca5-7e524d019041 req-3bea8d2c-db4b-49bc-add3-96e0d1fc0bc4 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:21.221712 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-635af991-20b4-426a-9357-052461c434b6 tempest-TestMinimumBasicScenario-529562927 tempest-TestMinimumBasicScenario-529562927-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1820090257" status: 202 len: 0 microversion: 2.1 time: 0.039143 May 19 06:36:21.222882 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 304/607] 10.222.0.65 () {58 vars in 1271 bytes} [Thu May 19 06:36:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1820090257 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 06:36:21.230966 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-27728509-e2d6-4993-9ca5-7e524d019041 req-3bea8d2c-db4b-49bc-add3-96e0d1fc0bc4 service nova] Creating event network-changed:b7db8c94-9859-474d-a448-c4072b873d7e for instance 747b4d4e-1bee-499b-bef9-380ab08e3594 on hv-cinder-83699 May 19 06:36:21.237826 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-27728509-e2d6-4993-9ca5-7e524d019041 req-3bea8d2c-db4b-49bc-add3-96e0d1fc0bc4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047061 May 19 06:36:21.238707 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 304/608] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:36:21.912721 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1ee51f4a-2b37-4145-818d-ecf705fb0fa1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:21.914199 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1ee51f4a-2b37-4145-818d-ecf705fb0fa1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:21.922295 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1ee51f4a-2b37-4145-818d-ecf705fb0fa1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:21.922783 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1ee51f4a-2b37-4145-818d-ecf705fb0fa1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:21.923572 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1ee51f4a-2b37-4145-818d-ecf705fb0fa1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:21.924033 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1ee51f4a-2b37-4145-818d-ecf705fb0fa1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:22.084656 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1ee51f4a-2b37-4145-818d-ecf705fb0fa1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:22.103311 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1ee51f4a-2b37-4145-818d-ecf705fb0fa1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1687 microversion: 2.1 time: 0.196041 May 19 06:36:22.104011 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 305/609] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:21 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1687 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:36:23.124130 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5adac065-b6fc-4689-9bef-99c1af6c9c7e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:23.124952 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5adac065-b6fc-4689-9bef-99c1af6c9c7e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:23.131139 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5adac065-b6fc-4689-9bef-99c1af6c9c7e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:23.131655 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5adac065-b6fc-4689-9bef-99c1af6c9c7e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:23.132533 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5adac065-b6fc-4689-9bef-99c1af6c9c7e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:23.132966 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5adac065-b6fc-4689-9bef-99c1af6c9c7e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:23.319447 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5adac065-b6fc-4689-9bef-99c1af6c9c7e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:23.331422 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5adac065-b6fc-4689-9bef-99c1af6c9c7e tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1687 microversion: 2.1 time: 0.212158 May 19 06:36:23.341968 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 305/610] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:23 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1687 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:36:24.354917 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4763b803-208a-41f5-bc99-4b5f86f82542 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:24.357493 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4763b803-208a-41f5-bc99-4b5f86f82542 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:24.372511 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4763b803-208a-41f5-bc99-4b5f86f82542 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:24.374095 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4763b803-208a-41f5-bc99-4b5f86f82542 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:24.375767 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4763b803-208a-41f5-bc99-4b5f86f82542 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:24.376838 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4763b803-208a-41f5-bc99-4b5f86f82542 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:24.891897 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-4763b803-208a-41f5-bc99-4b5f86f82542 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:24.901162 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4763b803-208a-41f5-bc99-4b5f86f82542 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1687 microversion: 2.1 time: 0.555383 May 19 06:36:24.912271 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 306/611] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:24 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1687 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:36:25.498297 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-92b10823-dc77-49fc-b89c-69842253e1ee req-a660c8c5-484f-4919-9d5b-8814040e44f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e905065-4c72-403f-ba1f-3d56ec56b4f0", "name": "network-vif-deleted", "tag": "e9987cd3-ff74-46e7-8754-720b4458b23e"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:36:25.523053 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-92b10823-dc77-49fc-b89c-69842253e1ee req-a660c8c5-484f-4919-9d5b-8814040e44f9 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:25.523729 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-92b10823-dc77-49fc-b89c-69842253e1ee req-a660c8c5-484f-4919-9d5b-8814040e44f9 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:25.578692 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-92b10823-dc77-49fc-b89c-69842253e1ee req-a660c8c5-484f-4919-9d5b-8814040e44f9 service nova] Creating event network-vif-deleted:e9987cd3-ff74-46e7-8754-720b4458b23e for instance 3e905065-4c72-403f-ba1f-3d56ec56b4f0 on hv-cinder-83699 May 19 06:36:25.602399 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-92b10823-dc77-49fc-b89c-69842253e1ee req-a660c8c5-484f-4919-9d5b-8814040e44f9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112140 May 19 06:36:25.605690 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 306/612] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:36:25.925946 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-96617903-b2f3-48e5-a5ea-59f86d6effcb tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:25.927111 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-96617903-b2f3-48e5-a5ea-59f86d6effcb tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:25.946588 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-96617903-b2f3-48e5-a5ea-59f86d6effcb tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:25.948044 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-96617903-b2f3-48e5-a5ea-59f86d6effcb tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:25.949925 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-96617903-b2f3-48e5-a5ea-59f86d6effcb tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:25.956031 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-96617903-b2f3-48e5-a5ea-59f86d6effcb tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:26.024362 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-96617903-b2f3-48e5-a5ea-59f86d6effcb tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:26.025078 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-96617903-b2f3-48e5-a5ea-59f86d6effcb tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:26.025700 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-96617903-b2f3-48e5-a5ea-59f86d6effcb tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lazy-loading 'fault' on Instance uuid 3e905065-4c72-403f-ba1f-3d56ec56b4f0 {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:36:26.114392 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-96617903-b2f3-48e5-a5ea-59f86d6effcb tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:26.124417 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-96617903-b2f3-48e5-a5ea-59f86d6effcb tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 200 len: 1333 microversion: 2.1 time: 0.206486 May 19 06:36:26.125727 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 307/613] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:25 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 1333 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:36:27.152528 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-57027810-d31d-4555-9d0f-47699765bfef tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:27.155094 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-57027810-d31d-4555-9d0f-47699765bfef tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 3e905065-4c72-403f-ba1f-3d56ec56b4f0] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:27.167535 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-57027810-d31d-4555-9d0f-47699765bfef tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:27.168353 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-57027810-d31d-4555-9d0f-47699765bfef tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:27.170235 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-57027810-d31d-4555-9d0f-47699765bfef tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:27.170913 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-57027810-d31d-4555-9d0f-47699765bfef tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:27.193648 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-57027810-d31d-4555-9d0f-47699765bfef tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] HTTP exception thrown: Instance 3e905065-4c72-403f-ba1f-3d56ec56b4f0 could not be found. May 19 06:36:27.196262 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-57027810-d31d-4555-9d0f-47699765bfef tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Request method failure captured: May 19 06:36:27.196262 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 HTTP/1.1 May 19 06:36:27.196262 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:36:27.196262 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:36:27.196262 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:36:27.196262 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 0 May 19 06:36:27.196262 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:36:27.196262 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:36:27.196262 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:36:27.196262 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:36:27.196262 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheQuT8V1GDiMH0DOO30Tfiq0zqgfOKtmbZZVfRuQfUb8iaIztwspeMTxkuDLD2JCWzCPycgw0CBN7_rmViHiNTGxyVziGruF8U08SJ90dqoSpsfL2qSZ-4DDY3yRLv9LzIxqZGYSN8qlP4jViuesPcXSDJ7XSg52MZEFyD7v7uiamXU May 19 06:36:27.196262 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:36:27.196262 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:36:27.196262 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:36:27.196262 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:36:27.196262 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:36:27.196262 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:36:27.196262 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: 35cb15f2075c41889b91291b645170a5 May 19 06:36:27.196262 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-802710311 May 19 06:36:27.196262 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:36:27.196262 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:36:27.199177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/35cb15f2075c41889b91291b645170a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/35cb15f2075c41889b91291b645170a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/35cb15f2075c41889b91291b645170a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_35cb15f2075c41889b91291b645170a5", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:36:27.199177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-ServerRescueNegativeTestJSON-802710311 May 19 06:36:27.199177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: 35cb15f2075c41889b91291b645170a5 May 19 06:36:27.199177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-802710311 May 19 06:36:27.199177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-ServerRescueNegativeTestJSON-802710311-project May 19 06:36:27.199177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:36:27.199177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:36:27.199177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: 6a71c3c016564c3b9ab0b6b58d378fda May 19 06:36:27.199177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-ServerRescueNegativeTestJSON-802710311-project May 19 06:36:27.199177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: > May 19 06:36:27.199177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Instance 3e905065-4c72-403f-ba1f-3d56ec56b4f0 could not be found. May 19 06:36:27.199177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'id': '3e905065-4c72-403f-ba1f-3d56ec56b4f0'} May 19 06:36:27.205516 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:36:27.205516 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:36:27.205516 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:36:27.205516 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:36:27.205516 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:36:27.205516 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:36:27.205516 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:36:27.205516 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:36:27.205516 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:36:27.205516 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:36:27.205516 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e905065-4c72-403f-ba1f-3d56ec56b4f0 could not be found. May 19 06:36:27.205516 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:36:27.205516 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:36:27.205516 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:36:27.205516 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:36:27.205516 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:36:27.205516 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:36:27.205516 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:36:27.205516 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:36:27.205516 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:36:27.208692 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:36:27.208692 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:36:27.208692 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:36:27.208692 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:36:27.208692 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:36:27.208692 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:36:27.208692 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:36:27.208692 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e905065-4c72-403f-ba1f-3d56ec56b4f0 could not be found. May 19 06:36:27.208692 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:36:27.208692 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:36:27.208692 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:36:27.208692 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:36:27.208692 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:36:27.208692 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:36:27.208692 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:36:27.208692 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:36:27.208692 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e905065-4c72-403f-ba1f-3d56ec56b4f0 could not be found. May 19 06:36:27.208692 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:36:27.210865 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-57027810-d31d-4555-9d0f-47699765bfef tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Returning 404 to user: Instance 3e905065-4c72-403f-ba1f-3d56ec56b4f0 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:36:27.210865 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-57027810-d31d-4555-9d0f-47699765bfef tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0" status: 404 len: 111 microversion: 2.1 time: 0.059060 May 19 06:36:27.210865 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 307/614] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:27 2022] GET /compute/v2.1/servers/3e905065-4c72-403f-ba1f-3d56ec56b4f0 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:36:27.220225 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2a834eab-e15b-4036-9ff0-7b52ccf35d36 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '.version_select at 0x7f9aeac460d0>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:27.250452 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2a834eab-e15b-4036-9ff0-7b52ccf35d36 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-101075626" status: 202 len: 0 microversion: 2.1 time: 0.037213 May 19 06:36:27.257246 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 308/615] 10.222.0.65 () {58 vars in 1217 bytes} [Thu May 19 06:36:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-101075626 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 06:36:30.825432 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d04b7633-f46a-49ef-bb23-58d5661c73f4 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:30.826108 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d04b7633-f46a-49ef-bb23-58d5661c73f4 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:30.833721 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d04b7633-f46a-49ef-bb23-58d5661c73f4 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:30.834289 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d04b7633-f46a-49ef-bb23-58d5661c73f4 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:30.835128 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d04b7633-f46a-49ef-bb23-58d5661c73f4 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:30.835636 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d04b7633-f46a-49ef-bb23-58d5661c73f4 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:30.866780 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d04b7633-f46a-49ef-bb23-58d5661c73f4 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Going to try to terminate instance {{(pid=117711) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 06:36:30.980792 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d04b7633-f46a-49ef-bb23-58d5661c73f4 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "DELETE /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 204 len: 0 microversion: 2.1 time: 0.158918 May 19 06:36:30.982593 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 308/616] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 06:36:30 2022] DELETE /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 06:36:30.999333 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-bd41f449-990c-49a3-b3a5-8e0e580b9ecf tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:31.000595 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-bd41f449-990c-49a3-b3a5-8e0e580b9ecf tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:31.015364 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bd41f449-990c-49a3-b3a5-8e0e580b9ecf tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:31.015912 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bd41f449-990c-49a3-b3a5-8e0e580b9ecf tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:31.017227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bd41f449-990c-49a3-b3a5-8e0e580b9ecf tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:31.017991 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bd41f449-990c-49a3-b3a5-8e0e580b9ecf tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:31.223401 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-bd41f449-990c-49a3-b3a5-8e0e580b9ecf tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:31.228808 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:36:31.245898 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-bd41f449-990c-49a3-b3a5-8e0e580b9ecf tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1506 microversion: 2.1 time: 0.257910 May 19 06:36:31.247959 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 309/617] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:30 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1506 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:36:32.277487 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-81999910-1fea-4f2b-b6d2-6dcd568e4262 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:32.279117 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-81999910-1fea-4f2b-b6d2-6dcd568e4262 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:32.286194 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-81999910-1fea-4f2b-b6d2-6dcd568e4262 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:32.286644 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-81999910-1fea-4f2b-b6d2-6dcd568e4262 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:32.287447 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-81999910-1fea-4f2b-b6d2-6dcd568e4262 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:32.287872 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-81999910-1fea-4f2b-b6d2-6dcd568e4262 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:32.478628 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-81999910-1fea-4f2b-b6d2-6dcd568e4262 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:32.487548 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-81999910-1fea-4f2b-b6d2-6dcd568e4262 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1506 microversion: 2.1 time: 0.214506 May 19 06:36:32.488698 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 309/618] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:32 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1506 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:36:33.516973 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b2f8b17d-eca6-47fe-b857-c8a3ad865d45 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:33.517820 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b2f8b17d-eca6-47fe-b857-c8a3ad865d45 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:33.531851 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b2f8b17d-eca6-47fe-b857-c8a3ad865d45 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:33.532324 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b2f8b17d-eca6-47fe-b857-c8a3ad865d45 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:33.533121 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b2f8b17d-eca6-47fe-b857-c8a3ad865d45 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:33.533646 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b2f8b17d-eca6-47fe-b857-c8a3ad865d45 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:33.792738 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b2f8b17d-eca6-47fe-b857-c8a3ad865d45 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:33.805243 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b2f8b17d-eca6-47fe-b857-c8a3ad865d45 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 200 len: 1506 microversion: 2.1 time: 0.296629 May 19 06:36:33.806497 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 310/619] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:33 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 1506 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:36:34.079277 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-a3b72083-085e-4be3-a96a-bd1e80823a0c req-4b8e8c66-d3b5-4e63-9670-b6775c06d6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88cd1ef9-5ec7-42ca-9204-dded848822ae", "name": "network-vif-deleted", "tag": "06df601d-f75d-4b75-b340-1e3f3982ca58"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:36:34.088652 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-a3b72083-085e-4be3-a96a-bd1e80823a0c req-4b8e8c66-d3b5-4e63-9670-b6775c06d6c6 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:34.089087 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-a3b72083-085e-4be3-a96a-bd1e80823a0c req-4b8e8c66-d3b5-4e63-9670-b6775c06d6c6 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:34.101406 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-a3b72083-085e-4be3-a96a-bd1e80823a0c req-4b8e8c66-d3b5-4e63-9670-b6775c06d6c6 service nova] Creating event network-vif-deleted:06df601d-f75d-4b75-b340-1e3f3982ca58 for instance 88cd1ef9-5ec7-42ca-9204-dded848822ae on hv-cinder-83699 May 19 06:36:34.108322 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-a3b72083-085e-4be3-a96a-bd1e80823a0c req-4b8e8c66-d3b5-4e63-9670-b6775c06d6c6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033725 May 19 06:36:34.109251 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 310/620] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:36:34.828661 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3f96fc64-3590-42b6-81d6-be2b1efa54ec tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:34.829444 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3f96fc64-3590-42b6-81d6-be2b1efa54ec tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 88cd1ef9-5ec7-42ca-9204-dded848822ae] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:34.837717 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3f96fc64-3590-42b6-81d6-be2b1efa54ec tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:34.838262 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3f96fc64-3590-42b6-81d6-be2b1efa54ec tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:34.839195 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3f96fc64-3590-42b6-81d6-be2b1efa54ec tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:34.839723 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3f96fc64-3590-42b6-81d6-be2b1efa54ec tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:34.857968 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-3f96fc64-3590-42b6-81d6-be2b1efa54ec tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] HTTP exception thrown: Instance 88cd1ef9-5ec7-42ca-9204-dded848822ae could not be found. May 19 06:36:34.859980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3f96fc64-3590-42b6-81d6-be2b1efa54ec tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Request method failure captured: May 19 06:36:34.859980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae HTTP/1.1 May 19 06:36:34.859980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept: application/json May 19 06:36:34.859980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity May 19 06:36:34.859980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Connection: close May 19 06:36:34.859980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Length: 0 May 19 06:36:34.859980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Type: application/json May 19 06:36:34.859980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Host: 10.222.0.65 May 19 06:36:34.859980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None May 19 06:36:34.859980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 May 19 06:36:34.859980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiheQuT8V1GDiMH0DOO30Tfiq0zqgfOKtmbZZVfRuQfUb8iaIztwspeMTxkuDLD2JCWzCPycgw0CBN7_rmViHiNTGxyVziGruF8U08SJ90dqoSpsfL2qSZ-4DDY3yRLv9LzIxqZGYSN8qlP4jViuesPcXSDJ7XSg52MZEFyD7v7uiamXU May 19 06:36:34.859980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Id: None May 19 06:36:34.859980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Name: None May 19 06:36:34.859980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed May 19 06:36:34.859980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True May 19 06:36:34.859980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default May 19 06:36:34.859980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default May 19 06:36:34.859980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Id: 35cb15f2075c41889b91291b645170a5 May 19 06:36:34.859980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-802710311 May 19 06:36:34.859980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Role: reader,member May 19 06:36:34.859980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Roles: reader,member May 19 06:36:34.862494 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/35cb15f2075c41889b91291b645170a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/35cb15f2075c41889b91291b645170a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/35cb15f2075c41889b91291b645170a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_35cb15f2075c41889b91291b645170a5", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:36:34.862494 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-ServerRescueNegativeTestJSON-802710311 May 19 06:36:34.862494 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Id: 35cb15f2075c41889b91291b645170a5 May 19 06:36:34.862494 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-802710311 May 19 06:36:34.862494 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User: tempest-ServerRescueNegativeTestJSON-802710311-project May 19 06:36:34.862494 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default May 19 06:36:34.862494 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default May 19 06:36:34.862494 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Id: 6a71c3c016564c3b9ab0b6b58d378fda May 19 06:36:34.862494 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-ServerRescueNegativeTestJSON-802710311-project May 19 06:36:34.862494 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: method: > May 19 06:36:34.862494 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: exception: Instance 88cd1ef9-5ec7-42ca-9204-dded848822ae could not be found. May 19 06:36:34.862494 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: action_args: {'id': '88cd1ef9-5ec7-42ca-9204-dded848822ae'} May 19 06:36:34.863968 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:36:34.863968 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:36:34.863968 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:36:34.863968 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:36:34.863968 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:36:34.863968 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:36:34.863968 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:36:34.863968 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:36:34.863968 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:36:34.863968 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:36:34.863968 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88cd1ef9-5ec7-42ca-9204-dded848822ae could not be found. May 19 06:36:34.863968 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:36:34.863968 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:36:34.863968 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:36:34.863968 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:36:34.863968 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:36:34.863968 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:36:34.863968 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:36:34.863968 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:36:34.863968 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:36:34.866294 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:36:34.866294 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:36:34.866294 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:36:34.866294 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:36:34.866294 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:36:34.866294 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:36:34.866294 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:36:34.866294 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88cd1ef9-5ec7-42ca-9204-dded848822ae could not be found. May 19 06:36:34.866294 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:36:34.866294 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:36:34.866294 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:36:34.866294 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:36:34.866294 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:36:34.866294 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:36:34.866294 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:36:34.866294 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:36:34.866294 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88cd1ef9-5ec7-42ca-9204-dded848822ae could not be found. May 19 06:36:34.866294 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:36:34.868275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3f96fc64-3590-42b6-81d6-be2b1efa54ec tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Returning 404 to user: Instance 88cd1ef9-5ec7-42ca-9204-dded848822ae could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:36:34.868275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3f96fc64-3590-42b6-81d6-be2b1efa54ec tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae" status: 404 len: 111 microversion: 2.1 time: 0.037008 May 19 06:36:34.868275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 311/621] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:34 2022] GET /compute/v2.1/servers/88cd1ef9-5ec7-42ca-9204-dded848822ae => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:36:34.872256 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f07f2e01-c90b-4448-939a-a8a2b98b6502 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:34.872505 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f07f2e01-c90b-4448-939a-a8a2b98b6502 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:34.880139 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f07f2e01-c90b-4448-939a-a8a2b98b6502 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:34.880734 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f07f2e01-c90b-4448-939a-a8a2b98b6502 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:34.881753 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f07f2e01-c90b-4448-939a-a8a2b98b6502 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:34.882307 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f07f2e01-c90b-4448-939a-a8a2b98b6502 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:34.913543 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f07f2e01-c90b-4448-939a-a8a2b98b6502 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Going to try to terminate instance {{(pid=117711) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 06:36:35.019985 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f07f2e01-c90b-4448-939a-a8a2b98b6502 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 204 len: 0 microversion: 2.1 time: 0.152133 May 19 06:36:35.020599 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 311/622] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 06:36:34 2022] DELETE /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 06:36:35.033485 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-342a98ee-d6a5-4460-843f-b6abe45e94cd tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:35.034613 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-342a98ee-d6a5-4460-843f-b6abe45e94cd tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:35.045643 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-342a98ee-d6a5-4460-843f-b6abe45e94cd tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:35.046404 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-342a98ee-d6a5-4460-843f-b6abe45e94cd tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:35.047746 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-342a98ee-d6a5-4460-843f-b6abe45e94cd tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:35.048620 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-342a98ee-d6a5-4460-843f-b6abe45e94cd tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:35.212253 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-342a98ee-d6a5-4460-843f-b6abe45e94cd tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:35.221425 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-342a98ee-d6a5-4460-843f-b6abe45e94cd tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.196029 May 19 06:36:35.222012 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 312/623] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:35 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:36:36.241023 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0dfc0d54-3e17-40e1-b5d2-03aea529a7d1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:36.241916 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0dfc0d54-3e17-40e1-b5d2-03aea529a7d1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:36.250261 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0dfc0d54-3e17-40e1-b5d2-03aea529a7d1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:36.250712 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0dfc0d54-3e17-40e1-b5d2-03aea529a7d1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:36.251491 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0dfc0d54-3e17-40e1-b5d2-03aea529a7d1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:36.251931 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0dfc0d54-3e17-40e1-b5d2-03aea529a7d1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:36.398010 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0dfc0d54-3e17-40e1-b5d2-03aea529a7d1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:36.406948 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0dfc0d54-3e17-40e1-b5d2-03aea529a7d1 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.171464 May 19 06:36:36.407558 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 312/624] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:36 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:36:37.425209 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a4c3beda-fd06-4b11-a098-84482341c0c2 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:37.426129 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a4c3beda-fd06-4b11-a098-84482341c0c2 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:37.433340 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a4c3beda-fd06-4b11-a098-84482341c0c2 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:37.434481 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a4c3beda-fd06-4b11-a098-84482341c0c2 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:37.435310 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a4c3beda-fd06-4b11-a098-84482341c0c2 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:37.435988 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a4c3beda-fd06-4b11-a098-84482341c0c2 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:37.611679 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a4c3beda-fd06-4b11-a098-84482341c0c2 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:37.620693 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a4c3beda-fd06-4b11-a098-84482341c0c2 tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.199327 May 19 06:36:37.621502 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 313/625] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:37 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:36:38.643649 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-4280bcc1-ea09-4667-b8b0-f6e04f56ff1c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:38.644456 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-4280bcc1-ea09-4667-b8b0-f6e04f56ff1c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:38.648901 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=3 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:36:38.660392 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4280bcc1-ea09-4667-b8b0-f6e04f56ff1c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:38.663903 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4280bcc1-ea09-4667-b8b0-f6e04f56ff1c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:38.665735 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4280bcc1-ea09-4667-b8b0-f6e04f56ff1c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:38.666744 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4280bcc1-ea09-4667-b8b0-f6e04f56ff1c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:38.690632 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:36:39.001394 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4280bcc1-ea09-4667-b8b0-f6e04f56ff1c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:39.015588 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-4280bcc1-ea09-4667-b8b0-f6e04f56ff1c tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1520 microversion: 2.1 time: 0.378933 May 19 06:36:39.016767 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 313/626] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:38 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1520 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:36:39.312690 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-95d0beb9-6175-44a1-b1e1-e23bcbe76248 req-e7b8bafb-48af-4f50-8332-c2e53036b090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f4202e4-0d0b-4d78-b9e3-a8e529700d8e", "name": "network-vif-deleted", "tag": "7b1f2836-944c-46f7-af0c-4d51b0b73e65"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:36:39.333820 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-95d0beb9-6175-44a1-b1e1-e23bcbe76248 req-e7b8bafb-48af-4f50-8332-c2e53036b090 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:39.334614 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-95d0beb9-6175-44a1-b1e1-e23bcbe76248 req-e7b8bafb-48af-4f50-8332-c2e53036b090 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:39.357825 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-95d0beb9-6175-44a1-b1e1-e23bcbe76248 req-e7b8bafb-48af-4f50-8332-c2e53036b090 service nova] Creating event network-vif-deleted:7b1f2836-944c-46f7-af0c-4d51b0b73e65 for instance 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e on hv-cinder-83699 May 19 06:36:39.366646 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-95d0beb9-6175-44a1-b1e1-e23bcbe76248 req-e7b8bafb-48af-4f50-8332-c2e53036b090 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061388 May 19 06:36:39.367744 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 314/627] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:36:40.040560 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-03637fcf-8c15-4923-9e8b-404ad45096dd tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:40.041617 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-03637fcf-8c15-4923-9e8b-404ad45096dd tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:40.050820 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-03637fcf-8c15-4923-9e8b-404ad45096dd tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:40.051531 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-03637fcf-8c15-4923-9e8b-404ad45096dd tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:40.052479 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-03637fcf-8c15-4923-9e8b-404ad45096dd tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:40.053153 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-03637fcf-8c15-4923-9e8b-404ad45096dd tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:40.098170 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-03637fcf-8c15-4923-9e8b-404ad45096dd tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:40.098860 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-03637fcf-8c15-4923-9e8b-404ad45096dd tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:40.099560 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-03637fcf-8c15-4923-9e8b-404ad45096dd tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lazy-loading 'fault' on Instance uuid 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:36:40.159304 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-03637fcf-8c15-4923-9e8b-404ad45096dd tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a71c3c016564c3b9ab0b6b58d378fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cb15f2075c41889b91291b645170a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:40.174413 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-03637fcf-8c15-4923-9e8b-404ad45096dd tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 200 len: 1311 microversion: 2.1 time: 0.137928 May 19 06:36:40.175502 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 314/628] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:40 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 1311 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:36:41.206714 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1161e5a3-b988-4ebf-9c72-f5b6a629f03f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:41.207694 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1161e5a3-b988-4ebf-9c72-f5b6a629f03f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] [instance: 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:41.216119 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1161e5a3-b988-4ebf-9c72-f5b6a629f03f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:41.216712 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1161e5a3-b988-4ebf-9c72-f5b6a629f03f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:41.217601 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1161e5a3-b988-4ebf-9c72-f5b6a629f03f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:41.218211 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1161e5a3-b988-4ebf-9c72-f5b6a629f03f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:41.235160 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-1161e5a3-b988-4ebf-9c72-f5b6a629f03f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] HTTP exception thrown: Instance 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e could not be found. May 19 06:36:41.236837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1161e5a3-b988-4ebf-9c72-f5b6a629f03f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Request method failure captured: May 19 06:36:41.236837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e HTTP/1.1 May 19 06:36:41.236837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept: application/json May 19 06:36:41.236837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity May 19 06:36:41.236837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Connection: close May 19 06:36:41.236837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Length: 0 May 19 06:36:41.236837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Type: application/json May 19 06:36:41.236837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Host: 10.222.0.65 May 19 06:36:41.236837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None May 19 06:36:41.236837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 May 19 06:36:41.236837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiheQuT8V1GDiMH0DOO30Tfiq0zqgfOKtmbZZVfRuQfUb8iaIztwspeMTxkuDLD2JCWzCPycgw0CBN7_rmViHiNTGxyVziGruF8U08SJ90dqoSpsfL2qSZ-4DDY3yRLv9LzIxqZGYSN8qlP4jViuesPcXSDJ7XSg52MZEFyD7v7uiamXU May 19 06:36:41.236837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Id: None May 19 06:36:41.236837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Name: None May 19 06:36:41.236837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed May 19 06:36:41.236837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True May 19 06:36:41.236837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default May 19 06:36:41.236837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default May 19 06:36:41.236837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Id: 35cb15f2075c41889b91291b645170a5 May 19 06:36:41.236837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-802710311 May 19 06:36:41.236837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Role: reader,member May 19 06:36:41.236837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Roles: reader,member May 19 06:36:41.239278 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/35cb15f2075c41889b91291b645170a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/35cb15f2075c41889b91291b645170a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/35cb15f2075c41889b91291b645170a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_35cb15f2075c41889b91291b645170a5", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:36:41.239278 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-ServerRescueNegativeTestJSON-802710311 May 19 06:36:41.239278 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Id: 35cb15f2075c41889b91291b645170a5 May 19 06:36:41.239278 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-802710311 May 19 06:36:41.239278 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User: tempest-ServerRescueNegativeTestJSON-802710311-project May 19 06:36:41.239278 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default May 19 06:36:41.239278 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default May 19 06:36:41.239278 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Id: 6a71c3c016564c3b9ab0b6b58d378fda May 19 06:36:41.239278 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-ServerRescueNegativeTestJSON-802710311-project May 19 06:36:41.239278 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: method: > May 19 06:36:41.239278 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: exception: Instance 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e could not be found. May 19 06:36:41.239278 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: action_args: {'id': '8f4202e4-0d0b-4d78-b9e3-a8e529700d8e'} May 19 06:36:41.240695 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:36:41.240695 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:36:41.240695 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:36:41.240695 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:36:41.240695 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:36:41.240695 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:36:41.240695 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:36:41.240695 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:36:41.240695 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:36:41.240695 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:36:41.240695 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e could not be found. May 19 06:36:41.240695 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:36:41.240695 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:36:41.240695 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:36:41.240695 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:36:41.240695 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:36:41.240695 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:36:41.240695 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:36:41.240695 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:36:41.240695 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:36:41.242926 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:36:41.242926 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:36:41.242926 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:36:41.242926 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:36:41.242926 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:36:41.242926 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:36:41.242926 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:36:41.242926 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e could not be found. May 19 06:36:41.242926 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:36:41.242926 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:36:41.242926 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:36:41.242926 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:36:41.242926 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:36:41.242926 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:36:41.242926 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:36:41.242926 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:36:41.242926 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e could not be found. May 19 06:36:41.242926 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:36:41.244982 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1161e5a3-b988-4ebf-9c72-f5b6a629f03f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] Returning 404 to user: Instance 8f4202e4-0d0b-4d78-b9e3-a8e529700d8e could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:36:41.244982 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1161e5a3-b988-4ebf-9c72-f5b6a629f03f tempest-ServerRescueNegativeTestJSON-802710311 tempest-ServerRescueNegativeTestJSON-802710311-project] 10.222.0.65 "GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e" status: 404 len: 111 microversion: 2.1 time: 0.038795 May 19 06:36:41.244982 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 315/629] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:36:41 2022] GET /compute/v2.1/servers/8f4202e4-0d0b-4d78-b9e3-a8e529700d8e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:36:47.980759 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c3871d88-19a1-470e-8fd4-0f33b89d4b05 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:47.981570 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c3871d88-19a1-470e-8fd4-0f33b89d4b05 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:47.991068 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c3871d88-19a1-470e-8fd4-0f33b89d4b05 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:47.991506 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c3871d88-19a1-470e-8fd4-0f33b89d4b05 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:47.992479 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c3871d88-19a1-470e-8fd4-0f33b89d4b05 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:47.993069 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c3871d88-19a1-470e-8fd4-0f33b89d4b05 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:48.019583 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c3871d88-19a1-470e-8fd4-0f33b89d4b05 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635/ips" status: 200 len: 145 microversion: 2.1 time: 0.048915 May 19 06:36:48.020840 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 315/630] 10.222.0.65 () {58 vars in 1247 bytes} [Thu May 19 06:36:47 2022] GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635/ips => generated 145 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:36:49.531059 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2cfafffe-6128-48e7-b0e5-81d9a3d53fc7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4d01d41-b812-492b-9caa-17d83b90a787"}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:36:49.532160 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-2cfafffe-6128-48e7-b0e5-81d9a3d53fc7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:49.551215 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:36:49.563279 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2cfafffe-6128-48e7-b0e5-81d9a3d53fc7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:49.563704 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2cfafffe-6128-48e7-b0e5-81d9a3d53fc7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:49.569237 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2cfafffe-6128-48e7-b0e5-81d9a3d53fc7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:49.569237 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2cfafffe-6128-48e7-b0e5-81d9a3d53fc7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:49.986553 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2cfafffe-6128-48e7-b0e5-81d9a3d53fc7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "POST /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.462621 May 19 06:36:49.987507 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 316/631] 10.222.0.65 () {60 vars in 1322 bytes} [Thu May 19 06:36:49 2022] POST /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635/os-volume_attachments => generated 194 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:36:51.824662 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b5fe66fb-5d34-46ff-b6b3-f712ab62a238 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Action: 'create', calling method: .version_select at 0x7f9aeb6bc310>, body: {"keypair": {"name": "tempest-keypair-1036593956", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqC9KBBw3Bwej9PTzofkc0eqRNB3ufAjn1L4ZamnRfbbyceEqM8RhXnIqe3wj4Mfw22VmcP03Zjs90T5/Zl1jSbWx39K4/rLOGwxNzMWBmZKDdggfneZPpi9N4ldwkSsw=="}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:36:51.840870 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-b5fe66fb-5d34-46ff-b6b3-f712ab62a238 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Getting quotas for project e21ed8d40dab40828a1fc685ca63ad92. Resources: {'key_pairs'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:36:51.846460 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-b5fe66fb-5d34-46ff-b6b3-f712ab62a238 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Getting quotas for user 3a8abbf889e149f5be25ecddb22384a5 and project e21ed8d40dab40828a1fc685ca63ad92. Resources: {'key_pairs'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:36:51.878798 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b5fe66fb-5d34-46ff-b6b3-f712ab62a238 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.213965 May 19 06:36:51.879829 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 316/632] 10.222.0.65 () {62 vars in 1199 bytes} [Thu May 19 06:36:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 216 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 19 06:36:53.347597 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6d031061-c710-4a05-9d17-8d2b67ea3951 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1915567242", "imageRef": "27959167-098e-44c5-ba0a-e9fb8054c377", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "57283c78-cedc-47c0-a4e8-516a188cf396"}], "security_groups": [{"name": "tempest-securitygroup--243987828"}], "key_name": "tempest-keypair-1036593956", "user_data": "}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:36:53.500640 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.network.neutron [None req-6d031061-c710-4a05-9d17-8d2b67ea3951 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] validate_networks() for [('57283c78-cedc-47c0-a4e8-516a188cf396', None, None, None, None, None)] {{(pid=117712) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 06:36:54.025044 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-6d031061-c710-4a05-9d17-8d2b67ea3951 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Flavor limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 06:36:54.025580 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-6d031061-c710-4a05-9d17-8d2b67ea3951 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Image limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 06:36:54.026312 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-6d031061-c710-4a05-9d17-8d2b67ea3951 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Flavor pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 06:36:54.027399 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-6d031061-c710-4a05-9d17-8d2b67ea3951 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Image pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 06:36:54.028433 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-6d031061-c710-4a05-9d17-8d2b67ea3951 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 06:36:54.037666 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6d031061-c710-4a05-9d17-8d2b67ea3951 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:54.038263 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6d031061-c710-4a05-9d17-8d2b67ea3951 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:54.039082 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6d031061-c710-4a05-9d17-8d2b67ea3951 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:54.039520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6d031061-c710-4a05-9d17-8d2b67ea3951 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:54.058829 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-6d031061-c710-4a05-9d17-8d2b67ea3951 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Getting quotas for project e21ed8d40dab40828a1fc685ca63ad92. Resources: {'ram', 'cores', 'instances'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:36:54.063561 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-6d031061-c710-4a05-9d17-8d2b67ea3951 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Getting quotas for user 3a8abbf889e149f5be25ecddb22384a5 and project e21ed8d40dab40828a1fc685ca63ad92. Resources: {'ram', 'cores', 'instances'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:36:54.076784 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-6d031061-c710-4a05-9d17-8d2b67ea3951 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Going to run 1 instances... {{(pid=117712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 06:36:54.079289 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-6d031061-c710-4a05-9d17-8d2b67ea3951 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27959167-098e-44c5-ba0a-e9fb8054c377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 06:36:54.137848 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6d031061-c710-4a05-9d17-8d2b67ea3951 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.799615 May 19 06:36:54.138807 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 317/633] 10.222.0.65 () {62 vars in 1187 bytes} [Thu May 19 06:36:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 06:36:54.149477 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b5df2c16-c6d3-4435-b3d0-2e8d5211fa7b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:54.151213 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b5df2c16-c6d3-4435-b3d0-2e8d5211fa7b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:54.225316 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b5df2c16-c6d3-4435-b3d0-2e8d5211fa7b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:54.235378 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b5df2c16-c6d3-4435-b3d0-2e8d5211fa7b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:54.237222 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b5df2c16-c6d3-4435-b3d0-2e8d5211fa7b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:54.238423 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b5df2c16-c6d3-4435-b3d0-2e8d5211fa7b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1282 microversion: 2.20 time: 0.093500 May 19 06:36:54.239197 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 317/634] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:36:54 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1282 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:36:55.258845 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a25b951a-9c98-4127-9d69-e4b695f76f12 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:55.259515 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a25b951a-9c98-4127-9d69-e4b695f76f12 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:55.268733 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a25b951a-9c98-4127-9d69-e4b695f76f12 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:55.269172 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a25b951a-9c98-4127-9d69-e4b695f76f12 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:55.270240 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a25b951a-9c98-4127-9d69-e4b695f76f12 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:55.270790 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a25b951a-9c98-4127-9d69-e4b695f76f12 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:55.341778 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a25b951a-9c98-4127-9d69-e4b695f76f12 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:55.353330 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a25b951a-9c98-4127-9d69-e4b695f76f12 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:55.355450 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a25b951a-9c98-4127-9d69-e4b695f76f12 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:55.356856 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a25b951a-9c98-4127-9d69-e4b695f76f12 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1342 microversion: 2.20 time: 0.102947 May 19 06:36:55.357878 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 318/635] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:36:55 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1342 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:36:56.377954 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a4856dd1-71dd-4828-9d01-34be91b9139a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:56.378778 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a4856dd1-71dd-4828-9d01-34be91b9139a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:56.390400 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a4856dd1-71dd-4828-9d01-34be91b9139a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:56.392014 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a4856dd1-71dd-4828-9d01-34be91b9139a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:56.394583 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a4856dd1-71dd-4828-9d01-34be91b9139a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:56.395955 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a4856dd1-71dd-4828-9d01-34be91b9139a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:56.698329 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a4856dd1-71dd-4828-9d01-34be91b9139a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:56.713334 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a4856dd1-71dd-4828-9d01-34be91b9139a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:56.715673 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a4856dd1-71dd-4828-9d01-34be91b9139a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:56.719626 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a4856dd1-71dd-4828-9d01-34be91b9139a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1407 microversion: 2.20 time: 0.344325 May 19 06:36:56.729383 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 318/636] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:36:56 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1407 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:36:56.730816 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a7a12c97-a3a4-412d-93db-a4f217e93069 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:56.733085 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a7a12c97-a3a4-412d-93db-a4f217e93069 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:56.747839 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a7a12c97-a3a4-412d-93db-a4f217e93069 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:56.748262 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a7a12c97-a3a4-412d-93db-a4f217e93069 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:56.749233 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a7a12c97-a3a4-412d-93db-a4f217e93069 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:56.749744 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a7a12c97-a3a4-412d-93db-a4f217e93069 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:56.785816 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a7a12c97-a3a4-412d-93db-a4f217e93069 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064465 May 19 06:36:56.786405 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 319/637] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 06:36:56 2022] GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:36:56.797111 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-eb52c10c-6d57-4545-b694-9cfc380a3b6a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:56.797805 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-eb52c10c-6d57-4545-b694-9cfc380a3b6a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:56.808458 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb52c10c-6d57-4545-b694-9cfc380a3b6a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:56.808853 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb52c10c-6d57-4545-b694-9cfc380a3b6a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:56.809682 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb52c10c-6d57-4545-b694-9cfc380a3b6a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:56.810130 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb52c10c-6d57-4545-b694-9cfc380a3b6a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:56.847087 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-eb52c10c-6d57-4545-b694-9cfc380a3b6a tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635/os-volume_attachments/d4d01d41-b812-492b-9caa-17d83b90a787" status: 200 len: 194 microversion: 2.1 time: 0.053789 May 19 06:36:56.847921 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 319/638] 10.222.0.65 () {58 vars in 1412 bytes} [Thu May 19 06:36:56 2022] GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635/os-volume_attachments/d4d01d41-b812-492b-9caa-17d83b90a787 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:36:57.431205 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-d6138f99-7898-4ad6-94d5-f0b6d7fcb4d8 req-ac80bed4-ab6e-4116-92ac-93cdfac0dd4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06323e6f-7b35-407f-aecf-5435fa013454", "tag": "b967f972-267a-488a-a383-8186a8a77201"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:36:57.446549 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-39bfb410-7a2f-4e59-b85b-6cb22f034b0f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:57.449922 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-39bfb410-7a2f-4e59-b85b-6cb22f034b0f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 747b4d4e-1bee-499b-bef9-380ab08e3594] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:57.458969 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-d6138f99-7898-4ad6-94d5-f0b6d7fcb4d8 req-ac80bed4-ab6e-4116-92ac-93cdfac0dd4d service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:57.459611 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-d6138f99-7898-4ad6-94d5-f0b6d7fcb4d8 req-ac80bed4-ab6e-4116-92ac-93cdfac0dd4d service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:57.460630 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-39bfb410-7a2f-4e59-b85b-6cb22f034b0f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:57.461090 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-39bfb410-7a2f-4e59-b85b-6cb22f034b0f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:57.461899 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-39bfb410-7a2f-4e59-b85b-6cb22f034b0f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:57.462513 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-39bfb410-7a2f-4e59-b85b-6cb22f034b0f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:57.476522 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-d6138f99-7898-4ad6-94d5-f0b6d7fcb4d8 req-ac80bed4-ab6e-4116-92ac-93cdfac0dd4d service nova] Creating event network-changed:b967f972-267a-488a-a383-8186a8a77201 for instance 06323e6f-7b35-407f-aecf-5435fa013454 on hv-cinder-83699 May 19 06:36:57.484909 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-d6138f99-7898-4ad6-94d5-f0b6d7fcb4d8 req-ac80bed4-ab6e-4116-92ac-93cdfac0dd4d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057400 May 19 06:36:57.486699 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 320/639] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:36:57.492710 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-39bfb410-7a2f-4e59-b85b-6cb22f034b0f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594/ips" status: 200 len: 147 microversion: 2.1 time: 0.055893 May 19 06:36:57.493363 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 320/640] 10.222.0.65 () {58 vars in 1247 bytes} [Thu May 19 06:36:57 2022] GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594/ips => generated 147 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:36:57.756129 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0bd26554-1ae2-4d9c-9074-9f8532cfb4d2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:57.757626 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0bd26554-1ae2-4d9c-9074-9f8532cfb4d2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:57.765886 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0bd26554-1ae2-4d9c-9074-9f8532cfb4d2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:57.766329 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0bd26554-1ae2-4d9c-9074-9f8532cfb4d2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:57.767332 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0bd26554-1ae2-4d9c-9074-9f8532cfb4d2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:57.767972 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0bd26554-1ae2-4d9c-9074-9f8532cfb4d2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:57.958782 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0bd26554-1ae2-4d9c-9074-9f8532cfb4d2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:57.969358 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0bd26554-1ae2-4d9c-9074-9f8532cfb4d2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:57.970977 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0bd26554-1ae2-4d9c-9074-9f8532cfb4d2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:57.972207 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0bd26554-1ae2-4d9c-9074-9f8532cfb4d2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1407 microversion: 2.20 time: 0.221172 May 19 06:36:57.973434 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 321/641] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:36:57 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:36:58.345106 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b920099e-58ae-4ec5-ae20-f3c1d1651b6f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0aca01b-ed52-4676-9680-e3c181e1a0b5"}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:36:58.346958 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b920099e-58ae-4ec5-ae20-f3c1d1651b6f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:58.357863 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b920099e-58ae-4ec5-ae20-f3c1d1651b6f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:58.358319 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b920099e-58ae-4ec5-ae20-f3c1d1651b6f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:58.359186 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b920099e-58ae-4ec5-ae20-f3c1d1651b6f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:58.359624 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b920099e-58ae-4ec5-ae20-f3c1d1651b6f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:58.992282 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-eeac96da-7b75-4535-b5c8-bfbf00687bad tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06d7a988-cdb6-46c2-97a9-85a4a912ecfb"}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:36:58.995062 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-eeac96da-7b75-4535-b5c8-bfbf00687bad tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 747b4d4e-1bee-499b-bef9-380ab08e3594] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:59.006732 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b920099e-58ae-4ec5-ae20-f3c1d1651b6f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "POST /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.669864 May 19 06:36:59.007680 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 321/642] 10.222.0.65 () {60 vars in 1322 bytes} [Thu May 19 06:36:58 2022] POST /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635/os-volume_attachments => generated 194 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:36:59.009614 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-eeac96da-7b75-4535-b5c8-bfbf00687bad tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:59.010577 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-eeac96da-7b75-4535-b5c8-bfbf00687bad tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:59.014861 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-eeac96da-7b75-4535-b5c8-bfbf00687bad tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:59.015942 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-eeac96da-7b75-4535-b5c8-bfbf00687bad tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:59.018772 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-315fc2a5-2828-4899-b6a0-0894952c6517 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:36:59.019950 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-315fc2a5-2828-4899-b6a0-0894952c6517 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:36:59.030479 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-315fc2a5-2828-4899-b6a0-0894952c6517 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:59.031204 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-315fc2a5-2828-4899-b6a0-0894952c6517 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:59.033067 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-315fc2a5-2828-4899-b6a0-0894952c6517 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:36:59.033802 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-315fc2a5-2828-4899-b6a0-0894952c6517 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:36:59.320998 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-315fc2a5-2828-4899-b6a0-0894952c6517 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:59.340414 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-315fc2a5-2828-4899-b6a0-0894952c6517 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:59.342142 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-315fc2a5-2828-4899-b6a0-0894952c6517 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:36:59.343670 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-315fc2a5-2828-4899-b6a0-0894952c6517 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1407 microversion: 2.20 time: 0.334678 May 19 06:36:59.344305 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 322/643] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:36:59 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1407 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:36:59.394062 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-eeac96da-7b75-4535-b5c8-bfbf00687bad tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "POST /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.408781 May 19 06:36:59.395162 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 322/644] 10.222.0.65 () {60 vars in 1322 bytes} [Thu May 19 06:36:58 2022] POST /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594/os-volume_attachments => generated 194 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:37:00.374859 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-9e5ae51f-0ac6-4597-b5f7-d5212d6d8963 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:00.375435 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-9e5ae51f-0ac6-4597-b5f7-d5212d6d8963 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:00.382070 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9e5ae51f-0ac6-4597-b5f7-d5212d6d8963 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:00.382514 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9e5ae51f-0ac6-4597-b5f7-d5212d6d8963 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:00.383320 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9e5ae51f-0ac6-4597-b5f7-d5212d6d8963 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:00.383750 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9e5ae51f-0ac6-4597-b5f7-d5212d6d8963 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:00.530004 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9e5ae51f-0ac6-4597-b5f7-d5212d6d8963 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:00.543123 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9e5ae51f-0ac6-4597-b5f7-d5212d6d8963 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:00.546014 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9e5ae51f-0ac6-4597-b5f7-d5212d6d8963 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:00.548039 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-9e5ae51f-0ac6-4597-b5f7-d5212d6d8963 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1407 microversion: 2.20 time: 0.178007 May 19 06:37:00.549081 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 323/645] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:37:00 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:37:01.567464 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-391b0e9d-6dad-4532-b53e-165c947f72f6 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:01.568156 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-391b0e9d-6dad-4532-b53e-165c947f72f6 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:01.574881 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-391b0e9d-6dad-4532-b53e-165c947f72f6 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:01.575331 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-391b0e9d-6dad-4532-b53e-165c947f72f6 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:01.576093 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-391b0e9d-6dad-4532-b53e-165c947f72f6 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:01.576520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-391b0e9d-6dad-4532-b53e-165c947f72f6 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:01.724377 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-391b0e9d-6dad-4532-b53e-165c947f72f6 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:01.739640 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-391b0e9d-6dad-4532-b53e-165c947f72f6 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:01.741478 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-391b0e9d-6dad-4532-b53e-165c947f72f6 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:01.742683 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-391b0e9d-6dad-4532-b53e-165c947f72f6 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1407 microversion: 2.20 time: 0.180054 May 19 06:37:01.743259 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 323/646] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:37:01 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:37:02.442638 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-d78cf5eb-5b1b-4941-b077-eef7277d0e39 req-5e5d8da0-dc0f-47d7-9032-e06c1b78f1c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06323e6f-7b35-407f-aecf-5435fa013454", "name": "network-vif-plugged", "status": "completed", "tag": "b967f972-267a-488a-a383-8186a8a77201"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:37:02.451307 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-d78cf5eb-5b1b-4941-b077-eef7277d0e39 req-5e5d8da0-dc0f-47d7-9032-e06c1b78f1c1 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:02.451746 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-d78cf5eb-5b1b-4941-b077-eef7277d0e39 req-5e5d8da0-dc0f-47d7-9032-e06c1b78f1c1 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:02.463125 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-d78cf5eb-5b1b-4941-b077-eef7277d0e39 req-5e5d8da0-dc0f-47d7-9032-e06c1b78f1c1 service nova] Creating event network-vif-plugged:b967f972-267a-488a-a383-8186a8a77201 for instance 06323e6f-7b35-407f-aecf-5435fa013454 on hv-cinder-83699 May 19 06:37:02.468809 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-d78cf5eb-5b1b-4941-b077-eef7277d0e39 req-5e5d8da0-dc0f-47d7-9032-e06c1b78f1c1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100141 May 19 06:37:02.469432 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 324/647] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:37:02.761362 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-31e460eb-3fe2-4453-ad35-0c26cb70d4c9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:02.762039 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-31e460eb-3fe2-4453-ad35-0c26cb70d4c9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:02.768602 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-31e460eb-3fe2-4453-ad35-0c26cb70d4c9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:02.769041 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-31e460eb-3fe2-4453-ad35-0c26cb70d4c9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:02.769834 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-31e460eb-3fe2-4453-ad35-0c26cb70d4c9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:02.770262 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-31e460eb-3fe2-4453-ad35-0c26cb70d4c9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:02.916550 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-31e460eb-3fe2-4453-ad35-0c26cb70d4c9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:02.925481 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-31e460eb-3fe2-4453-ad35-0c26cb70d4c9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:02.927035 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-31e460eb-3fe2-4453-ad35-0c26cb70d4c9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:02.928153 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-31e460eb-3fe2-4453-ad35-0c26cb70d4c9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1407 microversion: 2.20 time: 0.171119 May 19 06:37:02.928787 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 324/648] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:37:02 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:37:03.947788 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f7f3e23b-3894-4258-b2f3-bdb74ebba64b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:03.948684 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f7f3e23b-3894-4258-b2f3-bdb74ebba64b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:03.954942 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f7f3e23b-3894-4258-b2f3-bdb74ebba64b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:03.955386 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f7f3e23b-3894-4258-b2f3-bdb74ebba64b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:03.956142 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f7f3e23b-3894-4258-b2f3-bdb74ebba64b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:03.956571 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f7f3e23b-3894-4258-b2f3-bdb74ebba64b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:04.099531 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f7f3e23b-3894-4258-b2f3-bdb74ebba64b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:04.108598 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f7f3e23b-3894-4258-b2f3-bdb74ebba64b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:04.110148 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f7f3e23b-3894-4258-b2f3-bdb74ebba64b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:04.111314 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f7f3e23b-3894-4258-b2f3-bdb74ebba64b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1598 microversion: 2.20 time: 0.168685 May 19 06:37:04.111874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 325/649] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:37:03 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1598 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 06:37:04.129952 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b1439b02-915d-4ad5-a4ed-0b843e8b6e16 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:04.130507 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b1439b02-915d-4ad5-a4ed-0b843e8b6e16 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:04.132909 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:37:04.133572 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=6 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:37:04.140669 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b1439b02-915d-4ad5-a4ed-0b843e8b6e16 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:04.141127 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b1439b02-915d-4ad5-a4ed-0b843e8b6e16 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:04.141966 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b1439b02-915d-4ad5-a4ed-0b843e8b6e16 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:04.142409 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b1439b02-915d-4ad5-a4ed-0b843e8b6e16 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:04.145174 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:37:04.227348 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b1439b02-915d-4ad5-a4ed-0b843e8b6e16 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.101388 May 19 06:37:04.228204 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 325/650] 10.222.0.65 () {60 vars in 1315 bytes} [Thu May 19 06:37:04 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 06:37:05.306821 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=6 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:37:05.376645 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-e942df66-e00b-421d-932d-808dcfae1766 req-6b929448-6eb1-4080-bcf1-ac4f66b12aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06323e6f-7b35-407f-aecf-5435fa013454", "tag": "b967f972-267a-488a-a383-8186a8a77201"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:37:05.384938 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-e942df66-e00b-421d-932d-808dcfae1766 req-6b929448-6eb1-4080-bcf1-ac4f66b12aa7 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:05.385417 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-e942df66-e00b-421d-932d-808dcfae1766 req-6b929448-6eb1-4080-bcf1-ac4f66b12aa7 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:05.397868 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-e942df66-e00b-421d-932d-808dcfae1766 req-6b929448-6eb1-4080-bcf1-ac4f66b12aa7 service nova] Creating event network-changed:b967f972-267a-488a-a383-8186a8a77201 for instance 06323e6f-7b35-407f-aecf-5435fa013454 on hv-cinder-83699 May 19 06:37:05.403736 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-e942df66-e00b-421d-932d-808dcfae1766 req-6b929448-6eb1-4080-bcf1-ac4f66b12aa7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101733 May 19 06:37:05.404525 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 326/651] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:37:06.742581 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c56bd064-664d-478c-8d57-233f099957ba tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:06.744564 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c56bd064-664d-478c-8d57-233f099957ba tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:06.755208 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c56bd064-664d-478c-8d57-233f099957ba tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:06.755812 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c56bd064-664d-478c-8d57-233f099957ba tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:06.756730 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c56bd064-664d-478c-8d57-233f099957ba tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:06.757405 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c56bd064-664d-478c-8d57-233f099957ba tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:06.790682 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c56bd064-664d-478c-8d57-233f099957ba tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053997 May 19 06:37:06.791202 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 326/652] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 06:37:06 2022] GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:37:06.931573 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5015e484-0c41-4895-b737-9c757df3d86d tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:06.932290 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5015e484-0c41-4895-b737-9c757df3d86d tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:06.939548 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5015e484-0c41-4895-b737-9c757df3d86d tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:06.940197 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5015e484-0c41-4895-b737-9c757df3d86d tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:06.940833 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5015e484-0c41-4895-b737-9c757df3d86d tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:06.941339 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5015e484-0c41-4895-b737-9c757df3d86d tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:06.975142 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5015e484-0c41-4895-b737-9c757df3d86d tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635/os-volume_attachments/d4d01d41-b812-492b-9caa-17d83b90a787" status: 200 len: 194 microversion: 2.1 time: 0.049849 May 19 06:37:06.975983 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 327/653] 10.222.0.65 () {58 vars in 1412 bytes} [Thu May 19 06:37:06 2022] GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635/os-volume_attachments/d4d01d41-b812-492b-9caa-17d83b90a787 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:37:06.987377 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-eebbdb24-c760-497f-9b7d-d8e9377384ee tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:06.988109 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-eebbdb24-c760-497f-9b7d-d8e9377384ee tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:06.994552 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-eebbdb24-c760-497f-9b7d-d8e9377384ee tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:06.995652 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-eebbdb24-c760-497f-9b7d-d8e9377384ee tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:06.996481 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-eebbdb24-c760-497f-9b7d-d8e9377384ee tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:06.996918 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-eebbdb24-c760-497f-9b7d-d8e9377384ee tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:07.092044 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-eebbdb24-c760-497f-9b7d-d8e9377384ee tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lazy-loading 'services' on Instance uuid 80bd40e8-3416-4b6e-8655-40e57d12d635 {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:37:07.181079 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-eebbdb24-c760-497f-9b7d-d8e9377384ee tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "DELETE /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635/os-volume_attachments/d4d01d41-b812-492b-9caa-17d83b90a787" status: 202 len: 0 microversion: 2.1 time: 0.197961 May 19 06:37:07.181760 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 327/654] 10.222.0.65 () {58 vars in 1415 bytes} [Thu May 19 06:37:06 2022] DELETE /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635/os-volume_attachments/d4d01d41-b812-492b-9caa-17d83b90a787 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 06:37:12.431786 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-611de0cb-b525-4984-bff3-6895c4be671a tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:12.433734 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-611de0cb-b525-4984-bff3-6895c4be671a tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 747b4d4e-1bee-499b-bef9-380ab08e3594] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:12.435986 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:37:12.442621 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-611de0cb-b525-4984-bff3-6895c4be671a tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:12.442990 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-611de0cb-b525-4984-bff3-6895c4be671a tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:12.443766 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-611de0cb-b525-4984-bff3-6895c4be671a tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:12.444200 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-611de0cb-b525-4984-bff3-6895c4be671a tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:12.447945 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:37:12.560723 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-611de0cb-b525-4984-bff3-6895c4be671a tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lazy-loading 'services' on Instance uuid 747b4d4e-1bee-499b-bef9-380ab08e3594 {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:37:12.692256 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-611de0cb-b525-4984-bff3-6895c4be671a tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "DELETE /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594/os-volume_attachments/06d7a988-cdb6-46c2-97a9-85a4a912ecfb" status: 202 len: 0 microversion: 2.1 time: 0.264250 May 19 06:37:12.694996 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 328/655] 10.222.0.65 () {58 vars in 1415 bytes} [Thu May 19 06:37:12 2022] DELETE /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594/os-volume_attachments/06d7a988-cdb6-46c2-97a9-85a4a912ecfb => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 06:37:12.704316 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3877f0c8-5f6b-4a2b-b57a-df8f8d26f753 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:12.706284 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3877f0c8-5f6b-4a2b-b57a-df8f8d26f753 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 747b4d4e-1bee-499b-bef9-380ab08e3594] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:12.715377 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3877f0c8-5f6b-4a2b-b57a-df8f8d26f753 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:12.715992 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3877f0c8-5f6b-4a2b-b57a-df8f8d26f753 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:12.717056 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3877f0c8-5f6b-4a2b-b57a-df8f8d26f753 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:12.717728 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3877f0c8-5f6b-4a2b-b57a-df8f8d26f753 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:12.759666 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3877f0c8-5f6b-4a2b-b57a-df8f8d26f753 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060549 May 19 06:37:12.760795 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 328/656] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 06:37:12 2022] GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:37:13.707673 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-68a36202-de8e-4431-97c3-b0a273f80eb8 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:13.708267 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-68a36202-de8e-4431-97c3-b0a273f80eb8 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:13.716380 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-68a36202-de8e-4431-97c3-b0a273f80eb8 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:13.716834 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-68a36202-de8e-4431-97c3-b0a273f80eb8 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:13.717646 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-68a36202-de8e-4431-97c3-b0a273f80eb8 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:13.718085 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-68a36202-de8e-4431-97c3-b0a273f80eb8 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:13.751760 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-68a36202-de8e-4431-97c3-b0a273f80eb8 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635/os-volume_attachments/c0aca01b-ed52-4676-9680-e3c181e1a0b5" status: 200 len: 194 microversion: 2.1 time: 0.048847 May 19 06:37:13.752701 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 329/657] 10.222.0.65 () {58 vars in 1412 bytes} [Thu May 19 06:37:13 2022] GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635/os-volume_attachments/c0aca01b-ed52-4676-9680-e3c181e1a0b5 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:37:13.766254 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4f26eb43-c441-4c8d-a64d-bf65a4795f11 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:13.766800 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4f26eb43-c441-4c8d-a64d-bf65a4795f11 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:13.774768 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-aa25b64e-ac99-4722-afc5-a4bcb15a395b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:13.776638 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-aa25b64e-ac99-4722-afc5-a4bcb15a395b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 747b4d4e-1bee-499b-bef9-380ab08e3594] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:13.778960 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4f26eb43-c441-4c8d-a64d-bf65a4795f11 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:13.779419 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4f26eb43-c441-4c8d-a64d-bf65a4795f11 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:13.780222 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4f26eb43-c441-4c8d-a64d-bf65a4795f11 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:13.780656 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4f26eb43-c441-4c8d-a64d-bf65a4795f11 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:13.783619 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-aa25b64e-ac99-4722-afc5-a4bcb15a395b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:13.784069 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-aa25b64e-ac99-4722-afc5-a4bcb15a395b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:13.784847 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-aa25b64e-ac99-4722-afc5-a4bcb15a395b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:13.785309 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-aa25b64e-ac99-4722-afc5-a4bcb15a395b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:13.818468 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-aa25b64e-ac99-4722-afc5-a4bcb15a395b tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047781 May 19 06:37:13.819108 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 330/658] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 06:37:13 2022] GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 06:37:13.874179 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-4f26eb43-c441-4c8d-a64d-bf65a4795f11 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lazy-loading 'services' on Instance uuid 80bd40e8-3416-4b6e-8655-40e57d12d635 {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:37:13.883713 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-4703074a-e3d1-4960-9479-7e06f024dddf tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:13.884197 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-4703074a-e3d1-4960-9479-7e06f024dddf tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 747b4d4e-1bee-499b-bef9-380ab08e3594] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:13.891518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4703074a-e3d1-4960-9479-7e06f024dddf tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:13.891966 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4703074a-e3d1-4960-9479-7e06f024dddf tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:13.892742 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4703074a-e3d1-4960-9479-7e06f024dddf tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:13.893178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4703074a-e3d1-4960-9479-7e06f024dddf tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:13.922332 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-4703074a-e3d1-4960-9479-7e06f024dddf tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 747b4d4e-1bee-499b-bef9-380ab08e3594] Going to try to terminate instance {{(pid=117711) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 06:37:13.957011 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4f26eb43-c441-4c8d-a64d-bf65a4795f11 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "DELETE /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635/os-volume_attachments/c0aca01b-ed52-4676-9680-e3c181e1a0b5" status: 202 len: 0 microversion: 2.1 time: 0.195965 May 19 06:37:13.958099 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 329/659] 10.222.0.65 () {58 vars in 1415 bytes} [Thu May 19 06:37:13 2022] DELETE /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635/os-volume_attachments/c0aca01b-ed52-4676-9680-e3c181e1a0b5 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 06:37:14.034473 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-4703074a-e3d1-4960-9479-7e06f024dddf tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "DELETE /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594" status: 204 len: 0 microversion: 2.1 time: 0.153769 May 19 06:37:14.035593 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 331/660] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 06:37:13 2022] DELETE /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 06:37:14.050731 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-feddd079-67df-4a6a-8af4-b875781d692f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:14.051899 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-feddd079-67df-4a6a-8af4-b875781d692f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 747b4d4e-1bee-499b-bef9-380ab08e3594] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:14.066190 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-feddd079-67df-4a6a-8af4-b875781d692f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:14.066869 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-feddd079-67df-4a6a-8af4-b875781d692f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:14.068170 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-feddd079-67df-4a6a-8af4-b875781d692f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:14.068880 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-feddd079-67df-4a6a-8af4-b875781d692f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:14.253140 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-feddd079-67df-4a6a-8af4-b875781d692f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:14.261996 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-feddd079-67df-4a6a-8af4-b875781d692f tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594" status: 200 len: 1679 microversion: 2.1 time: 0.219082 May 19 06:37:14.262598 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 330/661] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:37:14 2022] GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594 => generated 1679 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:37:15.280730 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-de8b3a31-de24-46e9-8c83-95d4cdea7ef6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:15.281505 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-de8b3a31-de24-46e9-8c83-95d4cdea7ef6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 747b4d4e-1bee-499b-bef9-380ab08e3594] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:15.288264 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-de8b3a31-de24-46e9-8c83-95d4cdea7ef6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:15.288716 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-de8b3a31-de24-46e9-8c83-95d4cdea7ef6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:15.289532 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-de8b3a31-de24-46e9-8c83-95d4cdea7ef6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:15.289975 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-de8b3a31-de24-46e9-8c83-95d4cdea7ef6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:15.437531 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-de8b3a31-de24-46e9-8c83-95d4cdea7ef6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:15.445443 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-de8b3a31-de24-46e9-8c83-95d4cdea7ef6 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594" status: 200 len: 1679 microversion: 2.1 time: 0.169290 May 19 06:37:15.446048 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 332/662] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:37:15 2022] GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:37:16.215114 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3857273b-0d70-4ab3-ade5-c81151b003a1 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:16.216122 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3857273b-0d70-4ab3-ade5-c81151b003a1 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:16.223160 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3857273b-0d70-4ab3-ade5-c81151b003a1 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:16.223604 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3857273b-0d70-4ab3-ade5-c81151b003a1 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:16.224456 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3857273b-0d70-4ab3-ade5-c81151b003a1 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:16.224895 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3857273b-0d70-4ab3-ade5-c81151b003a1 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:16.262784 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3857273b-0d70-4ab3-ade5-c81151b003a1 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051630 May 19 06:37:16.263629 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 331/663] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 06:37:16 2022] GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 06:37:16.409850 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-fdbc4300-da42-4c92-a780-7c2131a9aed5 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:16.410836 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-fdbc4300-da42-4c92-a780-7c2131a9aed5 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:16.418799 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fdbc4300-da42-4c92-a780-7c2131a9aed5 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:16.419254 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fdbc4300-da42-4c92-a780-7c2131a9aed5 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:16.420052 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fdbc4300-da42-4c92-a780-7c2131a9aed5 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:16.420486 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fdbc4300-da42-4c92-a780-7c2131a9aed5 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:16.455586 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-fdbc4300-da42-4c92-a780-7c2131a9aed5 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050037 May 19 06:37:16.456196 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 333/664] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 06:37:16 2022] GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 06:37:16.465603 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-fcfd080f-7f5e-4da7-a77d-16e0d5e07b12 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:16.466228 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-fcfd080f-7f5e-4da7-a77d-16e0d5e07b12 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 747b4d4e-1bee-499b-bef9-380ab08e3594] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:16.472936 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fcfd080f-7f5e-4da7-a77d-16e0d5e07b12 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:16.473473 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fcfd080f-7f5e-4da7-a77d-16e0d5e07b12 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:16.475811 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fcfd080f-7f5e-4da7-a77d-16e0d5e07b12 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:16.476241 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fcfd080f-7f5e-4da7-a77d-16e0d5e07b12 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:16.530050 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8698a71b-efa0-46f4-a297-dcb7f4f61040 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:16.530562 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8698a71b-efa0-46f4-a297-dcb7f4f61040 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:16.537357 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8698a71b-efa0-46f4-a297-dcb7f4f61040 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:16.537819 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8698a71b-efa0-46f4-a297-dcb7f4f61040 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:16.539290 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8698a71b-efa0-46f4-a297-dcb7f4f61040 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:16.539734 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8698a71b-efa0-46f4-a297-dcb7f4f61040 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:16.549545 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-fcfd080f-7f5e-4da7-a77d-16e0d5e07b12 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:16.558132 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-fcfd080f-7f5e-4da7-a77d-16e0d5e07b12 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594" status: 200 len: 1612 microversion: 2.1 time: 0.096765 May 19 06:37:16.559057 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 332/665] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:37:16 2022] GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594 => generated 1612 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:37:16.583075 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8698a71b-efa0-46f4-a297-dcb7f4f61040 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Going to try to terminate instance {{(pid=117711) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 06:37:16.672232 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8698a71b-efa0-46f4-a297-dcb7f4f61040 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "DELETE /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635" status: 204 len: 0 microversion: 2.1 time: 0.147011 May 19 06:37:16.673517 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 334/666] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 06:37:16 2022] DELETE /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 06:37:16.683898 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-79b82b6b-2da0-42ae-ae48-0adfe4475a5f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:16.684521 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-79b82b6b-2da0-42ae-ae48-0adfe4475a5f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:16.690796 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-79b82b6b-2da0-42ae-ae48-0adfe4475a5f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:16.691242 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-79b82b6b-2da0-42ae-ae48-0adfe4475a5f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:16.692026 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-79b82b6b-2da0-42ae-ae48-0adfe4475a5f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:16.692454 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-79b82b6b-2da0-42ae-ae48-0adfe4475a5f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:16.771744 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-ac228132-5c08-4641-9127-7c8bc3707b6f req-8bab85d8-8879-4b7e-ab9e-0c5bf9b251df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "747b4d4e-1bee-499b-bef9-380ab08e3594", "name": "network-vif-deleted", "tag": "b7db8c94-9859-474d-a448-c4072b873d7e"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:37:16.781005 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-ac228132-5c08-4641-9127-7c8bc3707b6f req-8bab85d8-8879-4b7e-ab9e-0c5bf9b251df service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:16.786467 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-ac228132-5c08-4641-9127-7c8bc3707b6f req-8bab85d8-8879-4b7e-ab9e-0c5bf9b251df service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:16.801476 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-ac228132-5c08-4641-9127-7c8bc3707b6f req-8bab85d8-8879-4b7e-ab9e-0c5bf9b251df service nova] Creating event network-vif-deleted:b7db8c94-9859-474d-a448-c4072b873d7e for instance 747b4d4e-1bee-499b-bef9-380ab08e3594 on hv-cinder-83699 May 19 06:37:16.811923 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-ac228132-5c08-4641-9127-7c8bc3707b6f req-8bab85d8-8879-4b7e-ab9e-0c5bf9b251df service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041987 May 19 06:37:16.812601 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 335/667] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:37:16.940196 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-79b82b6b-2da0-42ae-ae48-0adfe4475a5f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:16.948994 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-79b82b6b-2da0-42ae-ae48-0adfe4475a5f tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635" status: 200 len: 1672 microversion: 2.1 time: 0.269620 May 19 06:37:16.949622 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 333/668] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:37:16 2022] GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635 => generated 1672 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:37:17.577415 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c735ba4e-3fbf-44fb-9d9f-050ace0aa892 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:17.578125 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c735ba4e-3fbf-44fb-9d9f-050ace0aa892 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 747b4d4e-1bee-499b-bef9-380ab08e3594] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:17.585082 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c735ba4e-3fbf-44fb-9d9f-050ace0aa892 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:17.585561 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c735ba4e-3fbf-44fb-9d9f-050ace0aa892 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:17.586390 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c735ba4e-3fbf-44fb-9d9f-050ace0aa892 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:17.586808 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c735ba4e-3fbf-44fb-9d9f-050ace0aa892 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:17.673851 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c735ba4e-3fbf-44fb-9d9f-050ace0aa892 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2bf8531dfe42b29b0b632b39d49625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbcff8654844c22a906a2e91ebca3bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:17.683241 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c735ba4e-3fbf-44fb-9d9f-050ace0aa892 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594" status: 200 len: 1612 microversion: 2.1 time: 0.110619 May 19 06:37:17.683855 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 336/669] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:37:17 2022] GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594 => generated 1612 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:37:17.974971 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-bd4dbcb2-36e4-4e92-a94d-6219f78e3abb tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:17.975546 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-bd4dbcb2-36e4-4e92-a94d-6219f78e3abb tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:17.982491 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bd4dbcb2-36e4-4e92-a94d-6219f78e3abb tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:17.982933 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bd4dbcb2-36e4-4e92-a94d-6219f78e3abb tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:17.983699 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bd4dbcb2-36e4-4e92-a94d-6219f78e3abb tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:17.984131 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bd4dbcb2-36e4-4e92-a94d-6219f78e3abb tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:18.129759 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-bd4dbcb2-36e4-4e92-a94d-6219f78e3abb tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:18.138777 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-bd4dbcb2-36e4-4e92-a94d-6219f78e3abb tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635" status: 200 len: 1672 microversion: 2.1 time: 0.167744 May 19 06:37:18.139761 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 334/670] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:37:17 2022] GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635 => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:37:18.704896 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-debf637c-7116-4120-9cdd-f85d0cb8ef34 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:18.708065 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-debf637c-7116-4120-9cdd-f85d0cb8ef34 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 747b4d4e-1bee-499b-bef9-380ab08e3594] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:18.727342 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-debf637c-7116-4120-9cdd-f85d0cb8ef34 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:18.727931 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-debf637c-7116-4120-9cdd-f85d0cb8ef34 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:18.729957 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-debf637c-7116-4120-9cdd-f85d0cb8ef34 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:18.730637 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-debf637c-7116-4120-9cdd-f85d0cb8ef34 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:18.748367 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-debf637c-7116-4120-9cdd-f85d0cb8ef34 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] HTTP exception thrown: Instance 747b4d4e-1bee-499b-bef9-380ab08e3594 could not be found. May 19 06:37:18.750574 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-debf637c-7116-4120-9cdd-f85d0cb8ef34 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Request method failure captured: May 19 06:37:18.750574 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594 HTTP/1.1 May 19 06:37:18.750574 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:37:18.750574 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:37:18.750574 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:37:18.750574 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 0 May 19 06:37:18.750574 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:37:18.750574 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:37:18.750574 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:37:18.750574 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:37:18.750574 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheQpEYHNc-bqZDbTw7Fp3ihyV0ldXUTzVqdWql59X0rABgHWrMJ_mmqGdwFukt62XCeg2LJEaWYizlEXJ-MFBwGucN9hE2YUn-VSsy8oJQ2x49K6gk4QQGlP2u7BGs_KXICLfWCW8W72y7YMhrOqThFt82dOSFW0U-RORzkOxIAljYo May 19 06:37:18.750574 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:37:18.750574 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:37:18.750574 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:37:18.750574 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:37:18.750574 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:37:18.750574 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:37:18.750574 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: adbcff8654844c22a906a2e91ebca3bb May 19 06:37:18.750574 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-AttachVolumeNegativeTest-624051308 May 19 06:37:18.750574 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:37:18.750574 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:37:18.752245 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_adbcff8654844c22a906a2e91ebca3bb", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:37:18.752245 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-AttachVolumeNegativeTest-624051308 May 19 06:37:18.752245 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: adbcff8654844c22a906a2e91ebca3bb May 19 06:37:18.752245 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-624051308 May 19 06:37:18.752245 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-AttachVolumeNegativeTest-624051308-project May 19 06:37:18.752245 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:37:18.752245 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:37:18.752245 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: cb2bf8531dfe42b29b0b632b39d49625 May 19 06:37:18.752245 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-AttachVolumeNegativeTest-624051308-project May 19 06:37:18.752245 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: > May 19 06:37:18.752245 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Instance 747b4d4e-1bee-499b-bef9-380ab08e3594 could not be found. May 19 06:37:18.752245 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'id': '747b4d4e-1bee-499b-bef9-380ab08e3594'} May 19 06:37:18.753188 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:37:18.753188 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:18.753188 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:37:18.753188 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:37:18.753188 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:37:18.753188 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:37:18.753188 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:37:18.753188 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:37:18.753188 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:37:18.753188 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:37:18.753188 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 747b4d4e-1bee-499b-bef9-380ab08e3594 could not be found. May 19 06:37:18.753188 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:18.753188 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:18.753188 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:18.753188 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:18.753188 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:18.753188 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:18.753188 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:37:18.753188 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:37:18.753188 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:37:18.754728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:37:18.754728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:37:18.754728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:37:18.754728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:37:18.754728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:37:18.754728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:37:18.754728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:37:18.754728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 747b4d4e-1bee-499b-bef9-380ab08e3594 could not be found. May 19 06:37:18.754728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:18.754728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:18.754728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:18.754728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:18.754728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:18.754728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:18.754728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:37:18.754728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:37:18.754728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 747b4d4e-1bee-499b-bef9-380ab08e3594 could not be found. May 19 06:37:18.754728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:18.756049 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-debf637c-7116-4120-9cdd-f85d0cb8ef34 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Returning 404 to user: Instance 747b4d4e-1bee-499b-bef9-380ab08e3594 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:37:18.756049 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-debf637c-7116-4120-9cdd-f85d0cb8ef34 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594" status: 404 len: 111 microversion: 2.1 time: 0.055568 May 19 06:37:18.756049 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 337/671] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:37:18 2022] GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:37:18.761092 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-eb9d6ece-82b3-409b-8d4d-81ebebc22c58 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '.version_select at 0x7f9aeac81a60>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:18.782454 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-eb9d6ece-82b3-409b-8d4d-81ebebc22c58 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1838394954" status: 202 len: 0 microversion: 2.1 time: 0.025265 May 19 06:37:18.783499 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 335/672] 10.222.0.65 () {58 vars in 1220 bytes} [Thu May 19 06:37:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1838394954 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 06:37:19.158537 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b7c16870-55c8-4a65-8441-583cb00cf2e9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:19.159203 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b7c16870-55c8-4a65-8441-583cb00cf2e9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:19.165943 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b7c16870-55c8-4a65-8441-583cb00cf2e9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:19.166764 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b7c16870-55c8-4a65-8441-583cb00cf2e9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:19.167762 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b7c16870-55c8-4a65-8441-583cb00cf2e9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:19.168213 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b7c16870-55c8-4a65-8441-583cb00cf2e9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:19.263634 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b7c16870-55c8-4a65-8441-583cb00cf2e9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3536012d1444a1b9b606c9ec94e5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8f1e4b9cd9432b90cb00a6be4d909e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:19.287988 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b7c16870-55c8-4a65-8441-583cb00cf2e9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635" status: 200 len: 1605 microversion: 2.1 time: 0.130987 May 19 06:37:19.289416 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 338/673] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:37:19 2022] GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635 => generated 1605 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:37:19.636545 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-892733a0-a369-4354-a188-e2b0b6f79064 req-5a1c51e4-792c-4940-9460-84bbf9b86a26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80bd40e8-3416-4b6e-8655-40e57d12d635", "name": "network-vif-deleted", "tag": "bb314e3e-a3eb-48a6-826d-79726548db0b"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:37:19.655563 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:37:19.660475 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-892733a0-a369-4354-a188-e2b0b6f79064 req-5a1c51e4-792c-4940-9460-84bbf9b86a26 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:19.661216 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-892733a0-a369-4354-a188-e2b0b6f79064 req-5a1c51e4-792c-4940-9460-84bbf9b86a26 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:19.688568 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-892733a0-a369-4354-a188-e2b0b6f79064 req-5a1c51e4-792c-4940-9460-84bbf9b86a26 service nova] Creating event network-vif-deleted:bb314e3e-a3eb-48a6-826d-79726548db0b for instance 80bd40e8-3416-4b6e-8655-40e57d12d635 on hv-cinder-83699 May 19 06:37:19.702210 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-892733a0-a369-4354-a188-e2b0b6f79064 req-5a1c51e4-792c-4940-9460-84bbf9b86a26 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075624 May 19 06:37:19.704005 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 336/674] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:37:20.312864 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-edb77fb2-d542-4751-9e92-d65fd75005d7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:20.314248 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-edb77fb2-d542-4751-9e92-d65fd75005d7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:20.326973 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-edb77fb2-d542-4751-9e92-d65fd75005d7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:20.327430 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-edb77fb2-d542-4751-9e92-d65fd75005d7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:20.328217 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-edb77fb2-d542-4751-9e92-d65fd75005d7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:20.328646 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-edb77fb2-d542-4751-9e92-d65fd75005d7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:20.345096 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-edb77fb2-d542-4751-9e92-d65fd75005d7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] HTTP exception thrown: Instance 80bd40e8-3416-4b6e-8655-40e57d12d635 could not be found. May 19 06:37:20.346681 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-edb77fb2-d542-4751-9e92-d65fd75005d7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Request method failure captured: May 19 06:37:20.346681 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635 HTTP/1.1 May 19 06:37:20.346681 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:37:20.346681 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:37:20.346681 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:37:20.346681 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 0 May 19 06:37:20.346681 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:37:20.346681 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:37:20.346681 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:37:20.346681 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:37:20.346681 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheQs5RxhNh599UW6hV5fPo6RDii2CBmb6-7-nZszVUgrqA2xFuzrtMyVWtLzjqLwk5EXhhuxA-Z7zkA0KrslrwqFRZJdr1gYO573BbyiEOoenZlHCaOQSo7977N0bxN_n9DlF_BdRmvDT13BEblTTl_tpdsNyOm1e-NqQpCuQT-xfz4 May 19 06:37:20.346681 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:37:20.346681 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:37:20.346681 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:37:20.346681 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:37:20.346681 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:37:20.346681 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:37:20.346681 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: 1e8f1e4b9cd9432b90cb00a6be4d909e May 19 06:37:20.346681 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-AttachVolumeTestJSON-1571186974 May 19 06:37:20.346681 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:37:20.346681 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:37:20.348490 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1e8f1e4b9cd9432b90cb00a6be4d909e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1e8f1e4b9cd9432b90cb00a6be4d909e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1e8f1e4b9cd9432b90cb00a6be4d909e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1e8f1e4b9cd9432b90cb00a6be4d909e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:37:20.348490 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-AttachVolumeTestJSON-1571186974 May 19 06:37:20.348490 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: 1e8f1e4b9cd9432b90cb00a6be4d909e May 19 06:37:20.348490 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1571186974 May 19 06:37:20.348490 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-AttachVolumeTestJSON-1571186974-project May 19 06:37:20.348490 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:37:20.348490 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:37:20.348490 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: 7a3536012d1444a1b9b606c9ec94e5cf May 19 06:37:20.348490 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-AttachVolumeTestJSON-1571186974-project May 19 06:37:20.348490 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: > May 19 06:37:20.348490 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Instance 80bd40e8-3416-4b6e-8655-40e57d12d635 could not be found. May 19 06:37:20.348490 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'id': '80bd40e8-3416-4b6e-8655-40e57d12d635'} May 19 06:37:20.349386 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:37:20.349386 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:20.349386 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:37:20.349386 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:37:20.349386 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:37:20.349386 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:37:20.349386 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:37:20.349386 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:37:20.349386 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:37:20.349386 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:37:20.349386 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80bd40e8-3416-4b6e-8655-40e57d12d635 could not be found. May 19 06:37:20.349386 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:20.349386 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:20.349386 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:20.349386 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:20.349386 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:20.349386 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:20.349386 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:37:20.349386 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:37:20.349386 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:37:20.350817 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:37:20.350817 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:37:20.350817 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:37:20.350817 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:37:20.350817 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:37:20.350817 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:37:20.350817 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:37:20.350817 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80bd40e8-3416-4b6e-8655-40e57d12d635 could not be found. May 19 06:37:20.350817 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:20.350817 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:20.350817 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:20.350817 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:20.350817 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:20.350817 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:20.350817 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:37:20.350817 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:37:20.350817 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80bd40e8-3416-4b6e-8655-40e57d12d635 could not be found. May 19 06:37:20.350817 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:20.352147 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-edb77fb2-d542-4751-9e92-d65fd75005d7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Returning 404 to user: Instance 80bd40e8-3416-4b6e-8655-40e57d12d635 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:37:20.352147 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-edb77fb2-d542-4751-9e92-d65fd75005d7 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635" status: 404 len: 111 microversion: 2.1 time: 0.040264 May 19 06:37:20.352147 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 339/675] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:37:20 2022] GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 06:37:20.358981 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-279a4e65-db90-4fc1-afef-ef29824164ee tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '.version_select at 0x7f9aeabde550>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:20.379856 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-279a4e65-db90-4fc1-afef-ef29824164ee tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1652551517" status: 202 len: 0 microversion: 2.1 time: 0.026083 May 19 06:37:20.380437 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 337/676] 10.222.0.65 () {58 vars in 1220 bytes} [Thu May 19 06:37:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1652551517 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 06:37:20.798605 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5a31f7cf-9e95-4137-a088-b42ad33978b1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:20.799435 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5a31f7cf-9e95-4137-a088-b42ad33978b1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 747b4d4e-1bee-499b-bef9-380ab08e3594] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:20.811290 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5a31f7cf-9e95-4137-a088-b42ad33978b1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:20.812001 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5a31f7cf-9e95-4137-a088-b42ad33978b1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:20.813399 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5a31f7cf-9e95-4137-a088-b42ad33978b1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:20.814309 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5a31f7cf-9e95-4137-a088-b42ad33978b1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:20.840165 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-5a31f7cf-9e95-4137-a088-b42ad33978b1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] HTTP exception thrown: Instance 747b4d4e-1bee-499b-bef9-380ab08e3594 could not be found. May 19 06:37:20.843221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5a31f7cf-9e95-4137-a088-b42ad33978b1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Request method failure captured: May 19 06:37:20.843221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: DELETE /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594 HTTP/1.1 May 19 06:37:20.843221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:37:20.843221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:37:20.843221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:37:20.843221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 0 May 19 06:37:20.843221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:37:20.843221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:37:20.843221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:37:20.843221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:37:20.843221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheQpEYHNc-bqZDbTw7Fp3ihyV0ldXUTzVqdWql59X0rABgHWrMJ_mmqGdwFukt62XCeg2LJEaWYizlEXJ-MFBwGucN9hE2YUn-VSsy8oJQ2x49K6gk4QQGlP2u7BGs_KXICLfWCW8W72y7YMhrOqThFt82dOSFW0U-RORzkOxIAljYo May 19 06:37:20.843221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:37:20.843221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:37:20.843221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:37:20.843221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:37:20.843221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:37:20.843221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:37:20.843221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: adbcff8654844c22a906a2e91ebca3bb May 19 06:37:20.843221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-AttachVolumeNegativeTest-624051308 May 19 06:37:20.843221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:37:20.843221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:37:20.846205 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_adbcff8654844c22a906a2e91ebca3bb", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:37:20.846205 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-AttachVolumeNegativeTest-624051308 May 19 06:37:20.846205 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: adbcff8654844c22a906a2e91ebca3bb May 19 06:37:20.846205 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-624051308 May 19 06:37:20.846205 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-AttachVolumeNegativeTest-624051308-project May 19 06:37:20.846205 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:37:20.846205 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:37:20.846205 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: cb2bf8531dfe42b29b0b632b39d49625 May 19 06:37:20.846205 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-AttachVolumeNegativeTest-624051308-project May 19 06:37:20.846205 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: > May 19 06:37:20.846205 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Instance 747b4d4e-1bee-499b-bef9-380ab08e3594 could not be found. May 19 06:37:20.846205 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'id': '747b4d4e-1bee-499b-bef9-380ab08e3594'} May 19 06:37:20.847833 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:37:20.847833 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:20.847833 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:37:20.847833 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:37:20.847833 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:37:20.847833 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:37:20.847833 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:37:20.847833 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:37:20.847833 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:37:20.847833 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:37:20.847833 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 747b4d4e-1bee-499b-bef9-380ab08e3594 could not be found. May 19 06:37:20.847833 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:20.847833 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:20.847833 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:20.847833 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:20.847833 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:20.847833 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:20.847833 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:37:20.847833 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:37:20.847833 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:37:20.850655 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:37:20.850655 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 06:37:20.850655 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 06:37:20.850655 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 06:37:20.850655 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 06:37:20.850655 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:37:20.850655 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:37:20.850655 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:37:20.850655 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:37:20.850655 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 747b4d4e-1bee-499b-bef9-380ab08e3594 could not be found. May 19 06:37:20.850655 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:20.850655 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:20.850655 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:20.850655 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:20.850655 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:20.850655 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:20.850655 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:37:20.850655 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:37:20.850655 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 747b4d4e-1bee-499b-bef9-380ab08e3594 could not be found. May 19 06:37:20.850655 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:20.855669 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5a31f7cf-9e95-4137-a088-b42ad33978b1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Returning 404 to user: Instance 747b4d4e-1bee-499b-bef9-380ab08e3594 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:37:20.855669 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5a31f7cf-9e95-4137-a088-b42ad33978b1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "DELETE /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594" status: 404 len: 111 microversion: 2.1 time: 0.052634 May 19 06:37:20.859140 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f676f3d3-f0b7-4b76-a431-847b62c5b90a tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:20.860355 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f676f3d3-f0b7-4b76-a431-847b62c5b90a tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 747b4d4e-1bee-499b-bef9-380ab08e3594] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:20.860646 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 340/677] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 06:37:20 2022] DELETE /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:37:20.871789 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f676f3d3-f0b7-4b76-a431-847b62c5b90a tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:20.872380 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f676f3d3-f0b7-4b76-a431-847b62c5b90a tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:20.874009 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f676f3d3-f0b7-4b76-a431-847b62c5b90a tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:20.874685 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f676f3d3-f0b7-4b76-a431-847b62c5b90a tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:20.901745 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-f676f3d3-f0b7-4b76-a431-847b62c5b90a tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] HTTP exception thrown: Instance 747b4d4e-1bee-499b-bef9-380ab08e3594 could not be found. May 19 06:37:20.904677 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f676f3d3-f0b7-4b76-a431-847b62c5b90a tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Request method failure captured: May 19 06:37:20.904677 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594 HTTP/1.1 May 19 06:37:20.904677 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept: application/json May 19 06:37:20.904677 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity May 19 06:37:20.904677 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Connection: close May 19 06:37:20.904677 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Length: 0 May 19 06:37:20.904677 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Type: application/json May 19 06:37:20.904677 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Host: 10.222.0.65 May 19 06:37:20.904677 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None May 19 06:37:20.904677 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 May 19 06:37:20.904677 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiheQpEYHNc-bqZDbTw7Fp3ihyV0ldXUTzVqdWql59X0rABgHWrMJ_mmqGdwFukt62XCeg2LJEaWYizlEXJ-MFBwGucN9hE2YUn-VSsy8oJQ2x49K6gk4QQGlP2u7BGs_KXICLfWCW8W72y7YMhrOqThFt82dOSFW0U-RORzkOxIAljYo May 19 06:37:20.904677 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Id: None May 19 06:37:20.904677 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Name: None May 19 06:37:20.904677 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed May 19 06:37:20.904677 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True May 19 06:37:20.904677 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default May 19 06:37:20.904677 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default May 19 06:37:20.904677 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Id: adbcff8654844c22a906a2e91ebca3bb May 19 06:37:20.904677 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-AttachVolumeNegativeTest-624051308 May 19 06:37:20.904677 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Role: reader,member May 19 06:37:20.904677 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Roles: reader,member May 19 06:37:20.906336 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_adbcff8654844c22a906a2e91ebca3bb", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:37:20.906336 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-AttachVolumeNegativeTest-624051308 May 19 06:37:20.906336 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Id: adbcff8654844c22a906a2e91ebca3bb May 19 06:37:20.906336 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-624051308 May 19 06:37:20.906336 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User: tempest-AttachVolumeNegativeTest-624051308-project May 19 06:37:20.906336 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default May 19 06:37:20.906336 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default May 19 06:37:20.906336 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Id: cb2bf8531dfe42b29b0b632b39d49625 May 19 06:37:20.906336 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-AttachVolumeNegativeTest-624051308-project May 19 06:37:20.906336 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: method: > May 19 06:37:20.906336 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: exception: Instance 747b4d4e-1bee-499b-bef9-380ab08e3594 could not be found. May 19 06:37:20.906336 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: action_args: {'id': '747b4d4e-1bee-499b-bef9-380ab08e3594'} May 19 06:37:20.907258 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:37:20.907258 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:20.907258 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:37:20.907258 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:37:20.907258 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:37:20.907258 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:37:20.907258 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:37:20.907258 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:37:20.907258 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:37:20.907258 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:37:20.907258 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 747b4d4e-1bee-499b-bef9-380ab08e3594 could not be found. May 19 06:37:20.907258 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:20.907258 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:20.907258 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:20.907258 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:20.907258 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:20.907258 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:20.907258 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:37:20.907258 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:37:20.907258 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:37:20.908560 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:37:20.908560 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:37:20.908560 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:37:20.908560 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:37:20.908560 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:37:20.908560 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:37:20.908560 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:37:20.908560 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 747b4d4e-1bee-499b-bef9-380ab08e3594 could not be found. May 19 06:37:20.908560 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:20.908560 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:20.908560 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:20.908560 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:20.908560 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:20.908560 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:20.908560 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:37:20.908560 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:37:20.908560 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 747b4d4e-1bee-499b-bef9-380ab08e3594 could not be found. May 19 06:37:20.908560 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:20.910215 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f676f3d3-f0b7-4b76-a431-847b62c5b90a tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Returning 404 to user: Instance 747b4d4e-1bee-499b-bef9-380ab08e3594 could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:37:20.910215 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f676f3d3-f0b7-4b76-a431-847b62c5b90a tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594" status: 404 len: 111 microversion: 2.1 time: 0.054897 May 19 06:37:20.911941 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 338/678] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:37:20 2022] GET /compute/v2.1/servers/747b4d4e-1bee-499b-bef9-380ab08e3594 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:37:22.085342 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1b075a19-1852-481a-b2c2-7aee09d51f44 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:22.085944 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-1b075a19-1852-481a-b2c2-7aee09d51f44 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: a0707826-af06-4e43-8b88-8243dd68c7be] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:22.093937 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1b075a19-1852-481a-b2c2-7aee09d51f44 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:22.094396 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1b075a19-1852-481a-b2c2-7aee09d51f44 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:22.095182 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1b075a19-1852-481a-b2c2-7aee09d51f44 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:22.095656 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1b075a19-1852-481a-b2c2-7aee09d51f44 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:22.111657 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-1b075a19-1852-481a-b2c2-7aee09d51f44 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] HTTP exception thrown: Instance a0707826-af06-4e43-8b88-8243dd68c7be could not be found. May 19 06:37:22.113220 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1b075a19-1852-481a-b2c2-7aee09d51f44 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Request method failure captured: May 19 06:37:22.113220 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: DELETE /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be HTTP/1.1 May 19 06:37:22.113220 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:37:22.113220 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:37:22.113220 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:37:22.113220 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 0 May 19 06:37:22.113220 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:37:22.113220 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:37:22.113220 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:37:22.113220 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:37:22.113220 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheQpEYHNc-bqZDbTw7Fp3ihyV0ldXUTzVqdWql59X0rABgHWrMJ_mmqGdwFukt62XCeg2LJEaWYizlEXJ-MFBwGucN9hE2YUn-VSsy8oJQ2x49K6gk4QQGlP2u7BGs_KXICLfWCW8W72y7YMhrOqThFt82dOSFW0U-RORzkOxIAljYo May 19 06:37:22.113220 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:37:22.113220 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:37:22.113220 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:37:22.113220 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:37:22.113220 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:37:22.113220 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:37:22.113220 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: adbcff8654844c22a906a2e91ebca3bb May 19 06:37:22.113220 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-AttachVolumeNegativeTest-624051308 May 19 06:37:22.113220 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:37:22.113220 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:37:22.114815 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_adbcff8654844c22a906a2e91ebca3bb", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:37:22.114815 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-AttachVolumeNegativeTest-624051308 May 19 06:37:22.114815 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: adbcff8654844c22a906a2e91ebca3bb May 19 06:37:22.114815 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-624051308 May 19 06:37:22.114815 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-AttachVolumeNegativeTest-624051308-project May 19 06:37:22.114815 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:37:22.114815 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:37:22.114815 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: cb2bf8531dfe42b29b0b632b39d49625 May 19 06:37:22.114815 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-AttachVolumeNegativeTest-624051308-project May 19 06:37:22.114815 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: > May 19 06:37:22.114815 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Instance a0707826-af06-4e43-8b88-8243dd68c7be could not be found. May 19 06:37:22.114815 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'id': 'a0707826-af06-4e43-8b88-8243dd68c7be'} May 19 06:37:22.115709 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:37:22.115709 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:22.115709 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:37:22.115709 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:37:22.115709 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:37:22.115709 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:37:22.115709 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:37:22.115709 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:37:22.115709 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:37:22.115709 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:37:22.115709 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0707826-af06-4e43-8b88-8243dd68c7be could not be found. May 19 06:37:22.115709 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:22.115709 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:22.115709 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:22.115709 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:22.115709 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:22.115709 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:22.115709 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:37:22.115709 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:37:22.115709 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:37:22.117178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:37:22.117178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 06:37:22.117178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 06:37:22.117178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 06:37:22.117178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 06:37:22.117178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:37:22.117178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:37:22.117178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:37:22.117178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:37:22.117178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0707826-af06-4e43-8b88-8243dd68c7be could not be found. May 19 06:37:22.117178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:22.117178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:22.117178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:22.117178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:22.117178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:22.117178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:22.117178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:37:22.117178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:37:22.117178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0707826-af06-4e43-8b88-8243dd68c7be could not be found. May 19 06:37:22.117178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:22.118751 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1b075a19-1852-481a-b2c2-7aee09d51f44 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Returning 404 to user: Instance a0707826-af06-4e43-8b88-8243dd68c7be could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:37:22.118751 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-1b075a19-1852-481a-b2c2-7aee09d51f44 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be" status: 404 len: 111 microversion: 2.1 time: 0.033216 May 19 06:37:22.118751 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 341/679] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 06:37:22 2022] DELETE /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 06:37:22.125411 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6c248093-3d3c-46d2-b7df-8a554d1c0dd4 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:22.126412 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-6c248093-3d3c-46d2-b7df-8a554d1c0dd4 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: a0707826-af06-4e43-8b88-8243dd68c7be] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:22.134063 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6c248093-3d3c-46d2-b7df-8a554d1c0dd4 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:22.134701 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6c248093-3d3c-46d2-b7df-8a554d1c0dd4 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:22.135670 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6c248093-3d3c-46d2-b7df-8a554d1c0dd4 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:22.136121 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6c248093-3d3c-46d2-b7df-8a554d1c0dd4 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:22.153309 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-6c248093-3d3c-46d2-b7df-8a554d1c0dd4 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] HTTP exception thrown: Instance a0707826-af06-4e43-8b88-8243dd68c7be could not be found. May 19 06:37:22.154984 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6c248093-3d3c-46d2-b7df-8a554d1c0dd4 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Request method failure captured: May 19 06:37:22.154984 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be HTTP/1.1 May 19 06:37:22.154984 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept: application/json May 19 06:37:22.154984 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity May 19 06:37:22.154984 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Connection: close May 19 06:37:22.154984 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Length: 0 May 19 06:37:22.154984 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Type: application/json May 19 06:37:22.154984 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Host: 10.222.0.65 May 19 06:37:22.154984 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None May 19 06:37:22.154984 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 May 19 06:37:22.154984 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiheQpEYHNc-bqZDbTw7Fp3ihyV0ldXUTzVqdWql59X0rABgHWrMJ_mmqGdwFukt62XCeg2LJEaWYizlEXJ-MFBwGucN9hE2YUn-VSsy8oJQ2x49K6gk4QQGlP2u7BGs_KXICLfWCW8W72y7YMhrOqThFt82dOSFW0U-RORzkOxIAljYo May 19 06:37:22.154984 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Id: None May 19 06:37:22.154984 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Name: None May 19 06:37:22.154984 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed May 19 06:37:22.154984 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True May 19 06:37:22.154984 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default May 19 06:37:22.154984 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default May 19 06:37:22.154984 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Id: adbcff8654844c22a906a2e91ebca3bb May 19 06:37:22.154984 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-AttachVolumeNegativeTest-624051308 May 19 06:37:22.154984 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Role: reader,member May 19 06:37:22.154984 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Roles: reader,member May 19 06:37:22.157242 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_adbcff8654844c22a906a2e91ebca3bb", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:37:22.157242 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-AttachVolumeNegativeTest-624051308 May 19 06:37:22.157242 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Id: adbcff8654844c22a906a2e91ebca3bb May 19 06:37:22.157242 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-624051308 May 19 06:37:22.157242 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User: tempest-AttachVolumeNegativeTest-624051308-project May 19 06:37:22.157242 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default May 19 06:37:22.157242 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default May 19 06:37:22.157242 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Id: cb2bf8531dfe42b29b0b632b39d49625 May 19 06:37:22.157242 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-AttachVolumeNegativeTest-624051308-project May 19 06:37:22.157242 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: method: > May 19 06:37:22.157242 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: exception: Instance a0707826-af06-4e43-8b88-8243dd68c7be could not be found. May 19 06:37:22.157242 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: action_args: {'id': 'a0707826-af06-4e43-8b88-8243dd68c7be'} May 19 06:37:22.158266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:37:22.158266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:22.158266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:37:22.158266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:37:22.158266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:37:22.158266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:37:22.158266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:37:22.158266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:37:22.158266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:37:22.158266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:37:22.158266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0707826-af06-4e43-8b88-8243dd68c7be could not be found. May 19 06:37:22.158266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:22.158266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:22.158266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:22.158266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:22.158266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:22.158266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:22.158266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:37:22.158266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:37:22.158266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:37:22.159837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:37:22.159837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:37:22.159837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:37:22.159837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:37:22.159837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:37:22.159837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:37:22.159837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:37:22.159837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0707826-af06-4e43-8b88-8243dd68c7be could not be found. May 19 06:37:22.159837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:22.159837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:22.159837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:22.159837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:22.159837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:22.159837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:22.159837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:37:22.159837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:37:22.159837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0707826-af06-4e43-8b88-8243dd68c7be could not be found. May 19 06:37:22.159837 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:22.161244 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6c248093-3d3c-46d2-b7df-8a554d1c0dd4 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Returning 404 to user: Instance a0707826-af06-4e43-8b88-8243dd68c7be could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:37:22.161244 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6c248093-3d3c-46d2-b7df-8a554d1c0dd4 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be" status: 404 len: 111 microversion: 2.1 time: 0.036149 May 19 06:37:22.161244 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 339/680] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:37:22 2022] GET /compute/v2.1/servers/a0707826-af06-4e43-8b88-8243dd68c7be => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:37:22.167489 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-da77a229-0f44-4263-9b06-9ae2d32351df tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:22.168272 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-da77a229-0f44-4263-9b06-9ae2d32351df tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:22.174788 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-da77a229-0f44-4263-9b06-9ae2d32351df tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:22.175237 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-da77a229-0f44-4263-9b06-9ae2d32351df tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:22.176020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-da77a229-0f44-4263-9b06-9ae2d32351df tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:22.176461 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-da77a229-0f44-4263-9b06-9ae2d32351df tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:22.191402 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-da77a229-0f44-4263-9b06-9ae2d32351df tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] HTTP exception thrown: Instance e8943880-a4d3-49d5-8c02-88ff7343f5fd could not be found. May 19 06:37:22.192959 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-da77a229-0f44-4263-9b06-9ae2d32351df tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Request method failure captured: May 19 06:37:22.192959 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: DELETE /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd HTTP/1.1 May 19 06:37:22.192959 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:37:22.192959 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:37:22.192959 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:37:22.192959 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 0 May 19 06:37:22.192959 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:37:22.192959 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:37:22.192959 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:37:22.192959 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:37:22.192959 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheQpEYHNc-bqZDbTw7Fp3ihyV0ldXUTzVqdWql59X0rABgHWrMJ_mmqGdwFukt62XCeg2LJEaWYizlEXJ-MFBwGucN9hE2YUn-VSsy8oJQ2x49K6gk4QQGlP2u7BGs_KXICLfWCW8W72y7YMhrOqThFt82dOSFW0U-RORzkOxIAljYo May 19 06:37:22.192959 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:37:22.192959 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:37:22.192959 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:37:22.192959 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:37:22.192959 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:37:22.192959 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:37:22.192959 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: adbcff8654844c22a906a2e91ebca3bb May 19 06:37:22.192959 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-AttachVolumeNegativeTest-624051308 May 19 06:37:22.192959 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:37:22.192959 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:37:22.194736 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_adbcff8654844c22a906a2e91ebca3bb", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:37:22.194736 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-AttachVolumeNegativeTest-624051308 May 19 06:37:22.194736 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: adbcff8654844c22a906a2e91ebca3bb May 19 06:37:22.194736 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-624051308 May 19 06:37:22.194736 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-AttachVolumeNegativeTest-624051308-project May 19 06:37:22.194736 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:37:22.194736 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:37:22.194736 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: cb2bf8531dfe42b29b0b632b39d49625 May 19 06:37:22.194736 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-AttachVolumeNegativeTest-624051308-project May 19 06:37:22.194736 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: > May 19 06:37:22.194736 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Instance e8943880-a4d3-49d5-8c02-88ff7343f5fd could not be found. May 19 06:37:22.194736 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'id': 'e8943880-a4d3-49d5-8c02-88ff7343f5fd'} May 19 06:37:22.195767 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:37:22.195767 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:22.195767 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:37:22.195767 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:37:22.195767 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:37:22.195767 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:37:22.195767 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:37:22.195767 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:37:22.195767 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:37:22.195767 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:37:22.195767 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8943880-a4d3-49d5-8c02-88ff7343f5fd could not be found. May 19 06:37:22.195767 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:22.195767 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:22.195767 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:22.195767 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:22.195767 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:22.195767 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:22.195767 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:37:22.195767 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:37:22.195767 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:37:22.197752 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:37:22.197752 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 06:37:22.197752 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 06:37:22.197752 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 06:37:22.197752 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 06:37:22.197752 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:37:22.197752 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:37:22.197752 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:37:22.197752 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:37:22.197752 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8943880-a4d3-49d5-8c02-88ff7343f5fd could not be found. May 19 06:37:22.197752 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:22.197752 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:22.197752 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:22.197752 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:22.197752 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:22.197752 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:22.197752 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:37:22.197752 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:37:22.197752 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8943880-a4d3-49d5-8c02-88ff7343f5fd could not be found. May 19 06:37:22.197752 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:22.199874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-da77a229-0f44-4263-9b06-9ae2d32351df tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Returning 404 to user: Instance e8943880-a4d3-49d5-8c02-88ff7343f5fd could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:37:22.199874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-da77a229-0f44-4263-9b06-9ae2d32351df tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd" status: 404 len: 111 microversion: 2.1 time: 0.032289 May 19 06:37:22.199874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 342/681] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 06:37:22 2022] DELETE /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:37:22.203255 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9c3da58e-64f8-4716-8f6e-94bd82b5c6d1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:22.204168 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9c3da58e-64f8-4716-8f6e-94bd82b5c6d1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: e8943880-a4d3-49d5-8c02-88ff7343f5fd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:22.212121 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9c3da58e-64f8-4716-8f6e-94bd82b5c6d1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:22.212580 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9c3da58e-64f8-4716-8f6e-94bd82b5c6d1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:22.213933 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9c3da58e-64f8-4716-8f6e-94bd82b5c6d1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:22.214979 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9c3da58e-64f8-4716-8f6e-94bd82b5c6d1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:22.230935 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-9c3da58e-64f8-4716-8f6e-94bd82b5c6d1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] HTTP exception thrown: Instance e8943880-a4d3-49d5-8c02-88ff7343f5fd could not be found. May 19 06:37:22.232502 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9c3da58e-64f8-4716-8f6e-94bd82b5c6d1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Request method failure captured: May 19 06:37:22.232502 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd HTTP/1.1 May 19 06:37:22.232502 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept: application/json May 19 06:37:22.232502 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity May 19 06:37:22.232502 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Connection: close May 19 06:37:22.232502 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Length: 0 May 19 06:37:22.232502 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Type: application/json May 19 06:37:22.232502 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Host: 10.222.0.65 May 19 06:37:22.232502 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None May 19 06:37:22.232502 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 May 19 06:37:22.232502 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiheQpEYHNc-bqZDbTw7Fp3ihyV0ldXUTzVqdWql59X0rABgHWrMJ_mmqGdwFukt62XCeg2LJEaWYizlEXJ-MFBwGucN9hE2YUn-VSsy8oJQ2x49K6gk4QQGlP2u7BGs_KXICLfWCW8W72y7YMhrOqThFt82dOSFW0U-RORzkOxIAljYo May 19 06:37:22.232502 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Id: None May 19 06:37:22.232502 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Name: None May 19 06:37:22.232502 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed May 19 06:37:22.232502 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True May 19 06:37:22.232502 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default May 19 06:37:22.232502 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default May 19 06:37:22.232502 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Id: adbcff8654844c22a906a2e91ebca3bb May 19 06:37:22.232502 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-AttachVolumeNegativeTest-624051308 May 19 06:37:22.232502 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Role: reader,member May 19 06:37:22.232502 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Roles: reader,member May 19 06:37:22.234158 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_adbcff8654844c22a906a2e91ebca3bb", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:37:22.234158 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-AttachVolumeNegativeTest-624051308 May 19 06:37:22.234158 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Id: adbcff8654844c22a906a2e91ebca3bb May 19 06:37:22.234158 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-624051308 May 19 06:37:22.234158 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User: tempest-AttachVolumeNegativeTest-624051308-project May 19 06:37:22.234158 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default May 19 06:37:22.234158 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default May 19 06:37:22.234158 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Id: cb2bf8531dfe42b29b0b632b39d49625 May 19 06:37:22.234158 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-AttachVolumeNegativeTest-624051308-project May 19 06:37:22.234158 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: method: > May 19 06:37:22.234158 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: exception: Instance e8943880-a4d3-49d5-8c02-88ff7343f5fd could not be found. May 19 06:37:22.234158 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: action_args: {'id': 'e8943880-a4d3-49d5-8c02-88ff7343f5fd'} May 19 06:37:22.235071 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:37:22.235071 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:22.235071 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:37:22.235071 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:37:22.235071 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:37:22.235071 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:37:22.235071 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:37:22.235071 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:37:22.235071 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:37:22.235071 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:37:22.235071 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8943880-a4d3-49d5-8c02-88ff7343f5fd could not be found. May 19 06:37:22.235071 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:22.235071 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:22.235071 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:22.235071 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:22.235071 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:22.235071 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:22.235071 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:37:22.235071 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:37:22.235071 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:37:22.236488 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:37:22.236488 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:37:22.236488 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:37:22.236488 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:37:22.236488 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:37:22.236488 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:37:22.236488 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:37:22.236488 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8943880-a4d3-49d5-8c02-88ff7343f5fd could not be found. May 19 06:37:22.236488 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:22.236488 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:22.236488 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:22.236488 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:22.236488 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:22.236488 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:22.236488 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:37:22.236488 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:37:22.236488 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8943880-a4d3-49d5-8c02-88ff7343f5fd could not be found. May 19 06:37:22.236488 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:22.237806 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9c3da58e-64f8-4716-8f6e-94bd82b5c6d1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Returning 404 to user: Instance e8943880-a4d3-49d5-8c02-88ff7343f5fd could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:37:22.237806 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9c3da58e-64f8-4716-8f6e-94bd82b5c6d1 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd" status: 404 len: 111 microversion: 2.1 time: 0.034793 May 19 06:37:22.237806 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 340/682] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:37:22 2022] GET /compute/v2.1/servers/e8943880-a4d3-49d5-8c02-88ff7343f5fd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:37:23.410373 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ed2d7592-7a90-413a-a8ae-8178fffa5296 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:23.410971 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ed2d7592-7a90-413a-a8ae-8178fffa5296 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:23.418502 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ed2d7592-7a90-413a-a8ae-8178fffa5296 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:23.418954 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ed2d7592-7a90-413a-a8ae-8178fffa5296 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:23.419739 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ed2d7592-7a90-413a-a8ae-8178fffa5296 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:23.420174 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ed2d7592-7a90-413a-a8ae-8178fffa5296 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:23.443801 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-ed2d7592-7a90-413a-a8ae-8178fffa5296 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] HTTP exception thrown: Instance 27482c04-b2af-4f4a-be37-655969d386cf could not be found. May 19 06:37:23.447190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ed2d7592-7a90-413a-a8ae-8178fffa5296 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Request method failure captured: May 19 06:37:23.447190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: DELETE /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf HTTP/1.1 May 19 06:37:23.447190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:37:23.447190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:37:23.447190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:37:23.447190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 0 May 19 06:37:23.447190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:37:23.447190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:37:23.447190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:37:23.447190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:37:23.447190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheQpEYHNc-bqZDbTw7Fp3ihyV0ldXUTzVqdWql59X0rABgHWrMJ_mmqGdwFukt62XCeg2LJEaWYizlEXJ-MFBwGucN9hE2YUn-VSsy8oJQ2x49K6gk4QQGlP2u7BGs_KXICLfWCW8W72y7YMhrOqThFt82dOSFW0U-RORzkOxIAljYo May 19 06:37:23.447190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:37:23.447190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:37:23.447190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:37:23.447190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:37:23.447190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:37:23.447190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:37:23.447190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: adbcff8654844c22a906a2e91ebca3bb May 19 06:37:23.447190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-AttachVolumeNegativeTest-624051308 May 19 06:37:23.447190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:37:23.447190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:37:23.449860 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_adbcff8654844c22a906a2e91ebca3bb", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:37:23.449860 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-AttachVolumeNegativeTest-624051308 May 19 06:37:23.449860 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: adbcff8654844c22a906a2e91ebca3bb May 19 06:37:23.449860 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-624051308 May 19 06:37:23.449860 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-AttachVolumeNegativeTest-624051308-project May 19 06:37:23.449860 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:37:23.449860 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:37:23.449860 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: cb2bf8531dfe42b29b0b632b39d49625 May 19 06:37:23.449860 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-AttachVolumeNegativeTest-624051308-project May 19 06:37:23.449860 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: > May 19 06:37:23.449860 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Instance 27482c04-b2af-4f4a-be37-655969d386cf could not be found. May 19 06:37:23.449860 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'id': '27482c04-b2af-4f4a-be37-655969d386cf'} May 19 06:37:23.451173 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:37:23.451173 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:23.451173 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:37:23.451173 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:37:23.451173 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:37:23.451173 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:37:23.451173 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:37:23.451173 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:37:23.451173 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:37:23.451173 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:37:23.451173 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27482c04-b2af-4f4a-be37-655969d386cf could not be found. May 19 06:37:23.451173 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:23.451173 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:23.451173 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:23.451173 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:23.451173 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:23.451173 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:23.451173 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:37:23.451173 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:37:23.451173 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:37:23.453707 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:37:23.453707 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 06:37:23.453707 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 06:37:23.453707 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 06:37:23.453707 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 06:37:23.453707 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:37:23.453707 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:37:23.453707 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:37:23.453707 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:37:23.453707 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27482c04-b2af-4f4a-be37-655969d386cf could not be found. May 19 06:37:23.453707 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:23.453707 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:23.453707 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:23.453707 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:23.453707 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:23.453707 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:23.453707 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:37:23.453707 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:37:23.453707 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27482c04-b2af-4f4a-be37-655969d386cf could not be found. May 19 06:37:23.453707 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:23.456167 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ed2d7592-7a90-413a-a8ae-8178fffa5296 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Returning 404 to user: Instance 27482c04-b2af-4f4a-be37-655969d386cf could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:37:23.456167 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ed2d7592-7a90-413a-a8ae-8178fffa5296 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "DELETE /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf" status: 404 len: 111 microversion: 2.1 time: 0.043615 May 19 06:37:23.456167 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 343/683] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 06:37:23 2022] DELETE /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:37:23.462568 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-08b604dd-a565-4306-9140-d26304bec431 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:23.464023 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-08b604dd-a565-4306-9140-d26304bec431 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] [instance: 27482c04-b2af-4f4a-be37-655969d386cf] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:23.473581 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-08b604dd-a565-4306-9140-d26304bec431 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:23.474275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-08b604dd-a565-4306-9140-d26304bec431 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:23.475580 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-08b604dd-a565-4306-9140-d26304bec431 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:23.476221 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-08b604dd-a565-4306-9140-d26304bec431 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:23.493543 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-08b604dd-a565-4306-9140-d26304bec431 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] HTTP exception thrown: Instance 27482c04-b2af-4f4a-be37-655969d386cf could not be found. May 19 06:37:23.495737 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-08b604dd-a565-4306-9140-d26304bec431 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Request method failure captured: May 19 06:37:23.495737 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf HTTP/1.1 May 19 06:37:23.495737 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept: application/json May 19 06:37:23.495737 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity May 19 06:37:23.495737 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Connection: close May 19 06:37:23.495737 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Length: 0 May 19 06:37:23.495737 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Type: application/json May 19 06:37:23.495737 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Host: 10.222.0.65 May 19 06:37:23.495737 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None May 19 06:37:23.495737 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 May 19 06:37:23.495737 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiheQpEYHNc-bqZDbTw7Fp3ihyV0ldXUTzVqdWql59X0rABgHWrMJ_mmqGdwFukt62XCeg2LJEaWYizlEXJ-MFBwGucN9hE2YUn-VSsy8oJQ2x49K6gk4QQGlP2u7BGs_KXICLfWCW8W72y7YMhrOqThFt82dOSFW0U-RORzkOxIAljYo May 19 06:37:23.495737 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Id: None May 19 06:37:23.495737 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Name: None May 19 06:37:23.495737 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed May 19 06:37:23.495737 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True May 19 06:37:23.495737 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default May 19 06:37:23.495737 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default May 19 06:37:23.495737 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Id: adbcff8654844c22a906a2e91ebca3bb May 19 06:37:23.495737 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-AttachVolumeNegativeTest-624051308 May 19 06:37:23.495737 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Role: reader,member May 19 06:37:23.495737 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Roles: reader,member May 19 06:37:23.497475 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/adbcff8654844c22a906a2e91ebca3bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_adbcff8654844c22a906a2e91ebca3bb", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:37:23.497475 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-AttachVolumeNegativeTest-624051308 May 19 06:37:23.497475 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Id: adbcff8654844c22a906a2e91ebca3bb May 19 06:37:23.497475 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-624051308 May 19 06:37:23.497475 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User: tempest-AttachVolumeNegativeTest-624051308-project May 19 06:37:23.497475 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default May 19 06:37:23.497475 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default May 19 06:37:23.497475 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Id: cb2bf8531dfe42b29b0b632b39d49625 May 19 06:37:23.497475 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-AttachVolumeNegativeTest-624051308-project May 19 06:37:23.497475 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: method: > May 19 06:37:23.497475 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: exception: Instance 27482c04-b2af-4f4a-be37-655969d386cf could not be found. May 19 06:37:23.497475 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: action_args: {'id': '27482c04-b2af-4f4a-be37-655969d386cf'} May 19 06:37:23.498395 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:37:23.498395 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:23.498395 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:37:23.498395 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:37:23.498395 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:37:23.498395 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:37:23.498395 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:37:23.498395 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:37:23.498395 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:37:23.498395 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:37:23.498395 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27482c04-b2af-4f4a-be37-655969d386cf could not be found. May 19 06:37:23.498395 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:23.498395 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:23.498395 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:23.498395 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:23.498395 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:23.498395 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:23.498395 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:37:23.498395 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:37:23.498395 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:37:23.499812 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:37:23.499812 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:37:23.499812 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:37:23.499812 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:37:23.499812 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:37:23.499812 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:37:23.499812 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:37:23.499812 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27482c04-b2af-4f4a-be37-655969d386cf could not be found. May 19 06:37:23.499812 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:23.499812 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:23.499812 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:23.499812 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:23.499812 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:23.499812 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:23.499812 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:37:23.499812 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:37:23.499812 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27482c04-b2af-4f4a-be37-655969d386cf could not be found. May 19 06:37:23.499812 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:23.501128 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-08b604dd-a565-4306-9140-d26304bec431 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] Returning 404 to user: Instance 27482c04-b2af-4f4a-be37-655969d386cf could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:37:23.501128 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-08b604dd-a565-4306-9140-d26304bec431 tempest-AttachVolumeNegativeTest-624051308 tempest-AttachVolumeNegativeTest-624051308-project] 10.222.0.65 "GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf" status: 404 len: 111 microversion: 2.1 time: 0.039917 May 19 06:37:23.501128 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 341/684] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:37:23 2022] GET /compute/v2.1/servers/27482c04-b2af-4f4a-be37-655969d386cf => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:37:23.778770 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3efdc7bd-3778-4fab-aa59-f0eda6a516a9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:23.779763 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-3efdc7bd-3778-4fab-aa59-f0eda6a516a9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:23.790454 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3efdc7bd-3778-4fab-aa59-f0eda6a516a9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:23.791336 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3efdc7bd-3778-4fab-aa59-f0eda6a516a9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:23.793368 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3efdc7bd-3778-4fab-aa59-f0eda6a516a9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:23.794232 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3efdc7bd-3778-4fab-aa59-f0eda6a516a9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:23.812113 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-3efdc7bd-3778-4fab-aa59-f0eda6a516a9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] HTTP exception thrown: Instance 80bd40e8-3416-4b6e-8655-40e57d12d635 could not be found. May 19 06:37:23.813702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3efdc7bd-3778-4fab-aa59-f0eda6a516a9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Request method failure captured: May 19 06:37:23.813702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: DELETE /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635 HTTP/1.1 May 19 06:37:23.813702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:37:23.813702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:37:23.813702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:37:23.813702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 0 May 19 06:37:23.813702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:37:23.813702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:37:23.813702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:37:23.813702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:37:23.813702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheQs5RxhNh599UW6hV5fPo6RDii2CBmb6-7-nZszVUgrqA2xFuzrtMyVWtLzjqLwk5EXhhuxA-Z7zkA0KrslrwqFRZJdr1gYO573BbyiEOoenZlHCaOQSo7977N0bxN_n9DlF_BdRmvDT13BEblTTl_tpdsNyOm1e-NqQpCuQT-xfz4 May 19 06:37:23.813702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:37:23.813702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:37:23.813702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:37:23.813702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:37:23.813702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:37:23.813702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:37:23.813702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: 1e8f1e4b9cd9432b90cb00a6be4d909e May 19 06:37:23.813702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-AttachVolumeTestJSON-1571186974 May 19 06:37:23.813702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:37:23.813702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:37:23.815456 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1e8f1e4b9cd9432b90cb00a6be4d909e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1e8f1e4b9cd9432b90cb00a6be4d909e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1e8f1e4b9cd9432b90cb00a6be4d909e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1e8f1e4b9cd9432b90cb00a6be4d909e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:37:23.815456 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-AttachVolumeTestJSON-1571186974 May 19 06:37:23.815456 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: 1e8f1e4b9cd9432b90cb00a6be4d909e May 19 06:37:23.815456 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1571186974 May 19 06:37:23.815456 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-AttachVolumeTestJSON-1571186974-project May 19 06:37:23.815456 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:37:23.815456 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:37:23.815456 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: 7a3536012d1444a1b9b606c9ec94e5cf May 19 06:37:23.815456 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-AttachVolumeTestJSON-1571186974-project May 19 06:37:23.815456 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: > May 19 06:37:23.815456 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Instance 80bd40e8-3416-4b6e-8655-40e57d12d635 could not be found. May 19 06:37:23.815456 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'id': '80bd40e8-3416-4b6e-8655-40e57d12d635'} May 19 06:37:23.816461 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:37:23.816461 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:23.816461 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:37:23.816461 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:37:23.816461 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:37:23.816461 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:37:23.816461 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:37:23.816461 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:37:23.816461 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:37:23.816461 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:37:23.816461 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80bd40e8-3416-4b6e-8655-40e57d12d635 could not be found. May 19 06:37:23.816461 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:23.816461 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:23.816461 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:23.816461 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:23.816461 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:23.816461 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:23.816461 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:37:23.816461 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:37:23.816461 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:37:23.818215 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:37:23.818215 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 06:37:23.818215 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 06:37:23.818215 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 06:37:23.818215 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 06:37:23.818215 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:37:23.818215 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:37:23.818215 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:37:23.818215 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:37:23.818215 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80bd40e8-3416-4b6e-8655-40e57d12d635 could not be found. May 19 06:37:23.818215 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:23.818215 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:23.818215 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:23.818215 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:23.818215 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:23.818215 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:23.818215 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:37:23.818215 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:37:23.818215 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80bd40e8-3416-4b6e-8655-40e57d12d635 could not be found. May 19 06:37:23.818215 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:23.820840 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3efdc7bd-3778-4fab-aa59-f0eda6a516a9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Returning 404 to user: Instance 80bd40e8-3416-4b6e-8655-40e57d12d635 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:37:23.820840 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-3efdc7bd-3778-4fab-aa59-f0eda6a516a9 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "DELETE /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635" status: 404 len: 111 microversion: 2.1 time: 0.043276 May 19 06:37:23.820840 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 344/685] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 06:37:23 2022] DELETE /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:37:23.823711 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e8dba06c-7d6d-4270-b580-810b9b70b6d1 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:23.824328 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e8dba06c-7d6d-4270-b580-810b9b70b6d1 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: 80bd40e8-3416-4b6e-8655-40e57d12d635] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:23.830582 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e8dba06c-7d6d-4270-b580-810b9b70b6d1 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:23.831034 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e8dba06c-7d6d-4270-b580-810b9b70b6d1 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:23.831808 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e8dba06c-7d6d-4270-b580-810b9b70b6d1 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:23.832243 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e8dba06c-7d6d-4270-b580-810b9b70b6d1 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:23.847782 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-e8dba06c-7d6d-4270-b580-810b9b70b6d1 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] HTTP exception thrown: Instance 80bd40e8-3416-4b6e-8655-40e57d12d635 could not be found. May 19 06:37:23.849402 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e8dba06c-7d6d-4270-b580-810b9b70b6d1 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Request method failure captured: May 19 06:37:23.849402 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635 HTTP/1.1 May 19 06:37:23.849402 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept: application/json May 19 06:37:23.849402 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity May 19 06:37:23.849402 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Connection: close May 19 06:37:23.849402 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Length: 0 May 19 06:37:23.849402 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Type: application/json May 19 06:37:23.849402 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Host: 10.222.0.65 May 19 06:37:23.849402 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None May 19 06:37:23.849402 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 May 19 06:37:23.849402 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiheQs5RxhNh599UW6hV5fPo6RDii2CBmb6-7-nZszVUgrqA2xFuzrtMyVWtLzjqLwk5EXhhuxA-Z7zkA0KrslrwqFRZJdr1gYO573BbyiEOoenZlHCaOQSo7977N0bxN_n9DlF_BdRmvDT13BEblTTl_tpdsNyOm1e-NqQpCuQT-xfz4 May 19 06:37:23.849402 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Id: None May 19 06:37:23.849402 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Name: None May 19 06:37:23.849402 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed May 19 06:37:23.849402 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True May 19 06:37:23.849402 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default May 19 06:37:23.849402 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default May 19 06:37:23.849402 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Id: 1e8f1e4b9cd9432b90cb00a6be4d909e May 19 06:37:23.849402 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-AttachVolumeTestJSON-1571186974 May 19 06:37:23.849402 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Role: reader,member May 19 06:37:23.849402 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Roles: reader,member May 19 06:37:23.850939 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1e8f1e4b9cd9432b90cb00a6be4d909e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1e8f1e4b9cd9432b90cb00a6be4d909e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1e8f1e4b9cd9432b90cb00a6be4d909e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1e8f1e4b9cd9432b90cb00a6be4d909e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:37:23.850939 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-AttachVolumeTestJSON-1571186974 May 19 06:37:23.850939 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Id: 1e8f1e4b9cd9432b90cb00a6be4d909e May 19 06:37:23.850939 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1571186974 May 19 06:37:23.850939 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User: tempest-AttachVolumeTestJSON-1571186974-project May 19 06:37:23.850939 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default May 19 06:37:23.850939 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default May 19 06:37:23.850939 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Id: 7a3536012d1444a1b9b606c9ec94e5cf May 19 06:37:23.850939 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-AttachVolumeTestJSON-1571186974-project May 19 06:37:23.850939 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: method: > May 19 06:37:23.850939 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: exception: Instance 80bd40e8-3416-4b6e-8655-40e57d12d635 could not be found. May 19 06:37:23.850939 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: action_args: {'id': '80bd40e8-3416-4b6e-8655-40e57d12d635'} May 19 06:37:23.851829 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:37:23.851829 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:23.851829 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:37:23.851829 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:37:23.851829 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:37:23.851829 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:37:23.851829 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:37:23.851829 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:37:23.851829 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:37:23.851829 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:37:23.851829 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80bd40e8-3416-4b6e-8655-40e57d12d635 could not be found. May 19 06:37:23.851829 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:23.851829 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:23.851829 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:23.851829 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:23.851829 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:23.851829 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:23.851829 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:37:23.851829 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:37:23.851829 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:37:23.854598 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:37:23.854598 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:37:23.854598 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:37:23.854598 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:37:23.854598 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:37:23.854598 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:37:23.854598 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:37:23.854598 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80bd40e8-3416-4b6e-8655-40e57d12d635 could not be found. May 19 06:37:23.854598 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:23.854598 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:23.854598 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:23.854598 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:23.854598 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:23.854598 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:23.854598 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:37:23.854598 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:37:23.854598 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80bd40e8-3416-4b6e-8655-40e57d12d635 could not be found. May 19 06:37:23.854598 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:23.855900 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e8dba06c-7d6d-4270-b580-810b9b70b6d1 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Returning 404 to user: Instance 80bd40e8-3416-4b6e-8655-40e57d12d635 could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:37:23.855900 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e8dba06c-7d6d-4270-b580-810b9b70b6d1 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635" status: 404 len: 111 microversion: 2.1 time: 0.031072 May 19 06:37:23.855900 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 342/686] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:37:23 2022] GET /compute/v2.1/servers/80bd40e8-3416-4b6e-8655-40e57d12d635 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 06:37:25.013162 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b108ffe9-8a70-40d0-a783-dadc4d027a52 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:25.014062 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b108ffe9-8a70-40d0-a783-dadc4d027a52 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:25.022247 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b108ffe9-8a70-40d0-a783-dadc4d027a52 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:25.022869 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b108ffe9-8a70-40d0-a783-dadc4d027a52 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:25.023799 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b108ffe9-8a70-40d0-a783-dadc4d027a52 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:25.024326 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b108ffe9-8a70-40d0-a783-dadc4d027a52 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:25.043707 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-b108ffe9-8a70-40d0-a783-dadc4d027a52 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] HTTP exception thrown: Instance ab7664a1-4da9-4338-996f-82bf458729ac could not be found. May 19 06:37:25.046098 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b108ffe9-8a70-40d0-a783-dadc4d027a52 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Request method failure captured: May 19 06:37:25.046098 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: DELETE /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac HTTP/1.1 May 19 06:37:25.046098 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:37:25.046098 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:37:25.046098 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:37:25.046098 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 0 May 19 06:37:25.046098 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:37:25.046098 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:37:25.046098 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:37:25.046098 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:37:25.046098 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheQs5RxhNh599UW6hV5fPo6RDii2CBmb6-7-nZszVUgrqA2xFuzrtMyVWtLzjqLwk5EXhhuxA-Z7zkA0KrslrwqFRZJdr1gYO573BbyiEOoenZlHCaOQSo7977N0bxN_n9DlF_BdRmvDT13BEblTTl_tpdsNyOm1e-NqQpCuQT-xfz4 May 19 06:37:25.046098 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:37:25.046098 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:37:25.046098 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:37:25.046098 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:37:25.046098 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:37:25.046098 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:37:25.046098 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: 1e8f1e4b9cd9432b90cb00a6be4d909e May 19 06:37:25.046098 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-AttachVolumeTestJSON-1571186974 May 19 06:37:25.046098 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:37:25.046098 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:37:25.049058 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1e8f1e4b9cd9432b90cb00a6be4d909e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1e8f1e4b9cd9432b90cb00a6be4d909e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1e8f1e4b9cd9432b90cb00a6be4d909e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1e8f1e4b9cd9432b90cb00a6be4d909e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:37:25.049058 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-AttachVolumeTestJSON-1571186974 May 19 06:37:25.049058 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: 1e8f1e4b9cd9432b90cb00a6be4d909e May 19 06:37:25.049058 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1571186974 May 19 06:37:25.049058 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-AttachVolumeTestJSON-1571186974-project May 19 06:37:25.049058 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:37:25.049058 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:37:25.049058 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: 7a3536012d1444a1b9b606c9ec94e5cf May 19 06:37:25.049058 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-AttachVolumeTestJSON-1571186974-project May 19 06:37:25.049058 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: > May 19 06:37:25.049058 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Instance ab7664a1-4da9-4338-996f-82bf458729ac could not be found. May 19 06:37:25.049058 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'id': 'ab7664a1-4da9-4338-996f-82bf458729ac'} May 19 06:37:25.050754 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:37:25.050754 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:25.050754 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:37:25.050754 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:37:25.050754 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:37:25.050754 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:37:25.050754 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:37:25.050754 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:37:25.050754 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:37:25.050754 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:37:25.050754 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab7664a1-4da9-4338-996f-82bf458729ac could not be found. May 19 06:37:25.050754 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:25.050754 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:25.050754 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:25.050754 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:25.050754 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:25.050754 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:25.050754 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:37:25.050754 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:37:25.050754 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:37:25.053501 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:37:25.053501 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 06:37:25.053501 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 06:37:25.053501 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 06:37:25.053501 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 06:37:25.053501 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:37:25.053501 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:37:25.053501 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:37:25.053501 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:37:25.053501 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab7664a1-4da9-4338-996f-82bf458729ac could not be found. May 19 06:37:25.053501 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:25.053501 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:25.053501 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:25.053501 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:25.053501 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:25.053501 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:25.053501 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:37:25.053501 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:37:25.053501 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab7664a1-4da9-4338-996f-82bf458729ac could not be found. May 19 06:37:25.053501 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:25.056056 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b108ffe9-8a70-40d0-a783-dadc4d027a52 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Returning 404 to user: Instance ab7664a1-4da9-4338-996f-82bf458729ac could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:37:25.056056 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b108ffe9-8a70-40d0-a783-dadc4d027a52 tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "DELETE /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 404 len: 111 microversion: 2.1 time: 0.039991 May 19 06:37:25.056056 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 345/687] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 06:37:25 2022] DELETE /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:37:25.063943 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b5ae4c8c-bc2d-4098-beab-70e343ad241e tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:25.065095 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b5ae4c8c-bc2d-4098-beab-70e343ad241e tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] [instance: ab7664a1-4da9-4338-996f-82bf458729ac] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:25.078443 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b5ae4c8c-bc2d-4098-beab-70e343ad241e tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:25.079252 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b5ae4c8c-bc2d-4098-beab-70e343ad241e tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:25.080658 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b5ae4c8c-bc2d-4098-beab-70e343ad241e tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:25.081484 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b5ae4c8c-bc2d-4098-beab-70e343ad241e tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:25.107459 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-b5ae4c8c-bc2d-4098-beab-70e343ad241e tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] HTTP exception thrown: Instance ab7664a1-4da9-4338-996f-82bf458729ac could not be found. May 19 06:37:25.110361 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b5ae4c8c-bc2d-4098-beab-70e343ad241e tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Request method failure captured: May 19 06:37:25.110361 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac HTTP/1.1 May 19 06:37:25.110361 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept: application/json May 19 06:37:25.110361 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity May 19 06:37:25.110361 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Connection: close May 19 06:37:25.110361 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Length: 0 May 19 06:37:25.110361 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Type: application/json May 19 06:37:25.110361 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Host: 10.222.0.65 May 19 06:37:25.110361 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None May 19 06:37:25.110361 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 May 19 06:37:25.110361 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiheQs5RxhNh599UW6hV5fPo6RDii2CBmb6-7-nZszVUgrqA2xFuzrtMyVWtLzjqLwk5EXhhuxA-Z7zkA0KrslrwqFRZJdr1gYO573BbyiEOoenZlHCaOQSo7977N0bxN_n9DlF_BdRmvDT13BEblTTl_tpdsNyOm1e-NqQpCuQT-xfz4 May 19 06:37:25.110361 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Id: None May 19 06:37:25.110361 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Name: None May 19 06:37:25.110361 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed May 19 06:37:25.110361 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True May 19 06:37:25.110361 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default May 19 06:37:25.110361 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default May 19 06:37:25.110361 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Id: 1e8f1e4b9cd9432b90cb00a6be4d909e May 19 06:37:25.110361 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-AttachVolumeTestJSON-1571186974 May 19 06:37:25.110361 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Role: reader,member May 19 06:37:25.110361 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Roles: reader,member May 19 06:37:25.112266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1e8f1e4b9cd9432b90cb00a6be4d909e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1e8f1e4b9cd9432b90cb00a6be4d909e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1e8f1e4b9cd9432b90cb00a6be4d909e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1e8f1e4b9cd9432b90cb00a6be4d909e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:37:25.112266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-AttachVolumeTestJSON-1571186974 May 19 06:37:25.112266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Id: 1e8f1e4b9cd9432b90cb00a6be4d909e May 19 06:37:25.112266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1571186974 May 19 06:37:25.112266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User: tempest-AttachVolumeTestJSON-1571186974-project May 19 06:37:25.112266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default May 19 06:37:25.112266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default May 19 06:37:25.112266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Id: 7a3536012d1444a1b9b606c9ec94e5cf May 19 06:37:25.112266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-AttachVolumeTestJSON-1571186974-project May 19 06:37:25.112266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: method: > May 19 06:37:25.112266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: exception: Instance ab7664a1-4da9-4338-996f-82bf458729ac could not be found. May 19 06:37:25.112266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: action_args: {'id': 'ab7664a1-4da9-4338-996f-82bf458729ac'} May 19 06:37:25.113142 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:37:25.113142 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:25.113142 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:37:25.113142 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:37:25.113142 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:37:25.113142 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:37:25.113142 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:37:25.113142 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:37:25.113142 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:37:25.113142 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:37:25.113142 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab7664a1-4da9-4338-996f-82bf458729ac could not be found. May 19 06:37:25.113142 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:25.113142 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:25.113142 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:25.113142 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:25.113142 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:25.113142 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:25.113142 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:37:25.113142 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:37:25.113142 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:37:25.114752 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:37:25.114752 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:37:25.114752 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:37:25.114752 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:37:25.114752 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:37:25.114752 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:37:25.114752 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:37:25.114752 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab7664a1-4da9-4338-996f-82bf458729ac could not be found. May 19 06:37:25.114752 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:25.114752 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:25.114752 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:25.114752 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:25.114752 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:25.114752 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:25.114752 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:37:25.114752 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:37:25.114752 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab7664a1-4da9-4338-996f-82bf458729ac could not be found. May 19 06:37:25.114752 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:25.115836 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b5ae4c8c-bc2d-4098-beab-70e343ad241e tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] Returning 404 to user: Instance ab7664a1-4da9-4338-996f-82bf458729ac could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:37:25.115836 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b5ae4c8c-bc2d-4098-beab-70e343ad241e tempest-AttachVolumeTestJSON-1571186974 tempest-AttachVolumeTestJSON-1571186974-project] 10.222.0.65 "GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac" status: 404 len: 111 microversion: 2.1 time: 0.056878 May 19 06:37:25.115836 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 343/688] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:37:25 2022] GET /compute/v2.1/servers/ab7664a1-4da9-4338-996f-82bf458729ac => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:37:31.686880 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f27dd755-62a0-4c90-ab56-0703ee3d50bd tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] Action: 'create', calling method: .version_select at 0x7f9aeb472670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-643229800"}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:37:32.187249 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f27dd755-62a0-4c90-ab56-0703ee3d50bd tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.678802 May 19 06:37:32.193362 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 346/689] 10.222.0.65 () {60 vars in 1154 bytes} [Thu May 19 06:37:31 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 681 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 19 06:37:32.200160 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ba2bb326-9f7a-4287-bdeb-5bf4c6af0641 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] Calling method '.version_select at 0x7f9aeac3d670>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:32.294852 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ba2bb326-9f7a-4287-bdeb-5bf4c6af0641 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/91913c1a-e743-407b-a7b9-1ca3fda987d5" status: 200 len: 344 microversion: 2.1 time: 0.099265 May 19 06:37:32.295430 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 344/690] 10.222.0.65 () {58 vars in 1244 bytes} [Thu May 19 06:37:32 2022] GET /compute/v2.1/os-volumes/91913c1a-e743-407b-a7b9-1ca3fda987d5 => generated 344 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:37:33.309120 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-4275438f-6d52-4547-afe5-3248a8d555d1 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] Calling method '.version_select at 0x7f9aeb4b6430>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:33.382314 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-4275438f-6d52-4547-afe5-3248a8d555d1 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/91913c1a-e743-407b-a7b9-1ca3fda987d5" status: 200 len: 345 microversion: 2.1 time: 0.079092 May 19 06:37:33.382891 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 347/691] 10.222.0.65 () {58 vars in 1244 bytes} [Thu May 19 06:37:33 2022] GET /compute/v2.1/os-volumes/91913c1a-e743-407b-a7b9-1ca3fda987d5 => generated 345 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:37:33.400716 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d7d1a3eb-a409-40a4-9971-6c8593941f63 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] Action: 'create', calling method: .version_select at 0x7f9aeac81a60>, body: {"snapshot": {"volume_id": "91913c1a-e743-407b-a7b9-1ca3fda987d5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1783903571"}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:37:33.618910 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d7d1a3eb-a409-40a4-9971-6c8593941f63 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] 10.222.0.65 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.222310 May 19 06:37:33.620500 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 345/692] 10.222.0.65 () {60 vars in 1161 bytes} [Thu May 19 06:37:33 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:37:33.659746 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-01d0307d-0dd5-4d01-aff3-14e8276d570a tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] Calling method '.version_select at 0x7f9aeb4b63a0>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:33.717670 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-01d0307d-0dd5-4d01-aff3-14e8276d570a tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/5b260de0-4daf-44ea-b829-1a73d382c832" status: 200 len: 287 microversion: 2.1 time: 0.087069 May 19 06:37:33.718557 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 348/693] 10.222.0.65 () {58 vars in 1250 bytes} [Thu May 19 06:37:33 2022] GET /compute/v2.1/os-snapshots/5b260de0-4daf-44ea-b829-1a73d382c832 => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:37:33.731290 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a90ced5b-3bff-42e6-add3-b9908b99520b tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] Calling method '.version_select at 0x7f9aeabde550>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:33.766135 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a90ced5b-3bff-42e6-add3-b9908b99520b tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.039222 May 19 06:37:33.766735 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 346/694] 10.222.0.65 () {58 vars in 1139 bytes} [Thu May 19 06:37:33 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:37:33.778244 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1678ec01-72da-454f-9b30-beeeb2bdad56 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] Calling method '.version_select at 0x7f9aeb4b6c10>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:33.808352 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-1678ec01-72da-454f-9b30-beeeb2bdad56 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/5b260de0-4daf-44ea-b829-1a73d382c832" status: 200 len: 287 microversion: 2.1 time: 0.035020 May 19 06:37:33.808966 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 349/695] 10.222.0.65 () {58 vars in 1250 bytes} [Thu May 19 06:37:33 2022] GET /compute/v2.1/os-snapshots/5b260de0-4daf-44ea-b829-1a73d382c832 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:37:34.821384 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4fff43a3-c2d4-484a-9703-11a106365c07 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] Calling method '.version_select at 0x7f9aeac3d430>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:34.855406 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4fff43a3-c2d4-484a-9703-11a106365c07 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/5b260de0-4daf-44ea-b829-1a73d382c832" status: 200 len: 287 microversion: 2.1 time: 0.038958 May 19 06:37:34.856081 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 347/696] 10.222.0.65 () {58 vars in 1250 bytes} [Thu May 19 06:37:34 2022] GET /compute/v2.1/os-snapshots/5b260de0-4daf-44ea-b829-1a73d382c832 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:37:35.865608 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:37:35.866664 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:37:35.873827 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6d0c6925-d125-4c7e-b91f-d9f95f3cded9 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] Calling method '.version_select at 0x7f9aeb6f8d30>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:35.923142 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6d0c6925-d125-4c7e-b91f-d9f95f3cded9 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/5b260de0-4daf-44ea-b829-1a73d382c832" status: 200 len: 287 microversion: 2.1 time: 0.058486 May 19 06:37:35.924416 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 350/697] 10.222.0.65 () {58 vars in 1250 bytes} [Thu May 19 06:37:35 2022] GET /compute/v2.1/os-snapshots/5b260de0-4daf-44ea-b829-1a73d382c832 => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:37:36.932811 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:37:36.933768 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:37:36.939249 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7623e344-11e4-4cbb-85bc-2b0d85482a4f tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] Calling method '.version_select at 0x7f9aeabe83a0>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:36.980057 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7623e344-11e4-4cbb-85bc-2b0d85482a4f tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/5b260de0-4daf-44ea-b829-1a73d382c832" status: 200 len: 288 microversion: 2.1 time: 0.047554 May 19 06:37:36.980636 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 348/698] 10.222.0.65 () {58 vars in 1250 bytes} [Thu May 19 06:37:36 2022] GET /compute/v2.1/os-snapshots/5b260de0-4daf-44ea-b829-1a73d382c832 => generated 288 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:37:36.997590 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-df3a8ad3-5d89-4467-bfd6-efbecd77eecb tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] Calling method '.version_select at 0x7f9aeb4725e0>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:37.068514 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-df3a8ad3-5d89-4467-bfd6-efbecd77eecb tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] 10.222.0.65 "DELETE /compute/v2.1/os-snapshots/5b260de0-4daf-44ea-b829-1a73d382c832" status: 202 len: 0 microversion: 2.1 time: 0.078288 May 19 06:37:37.073272 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 351/699] 10.222.0.65 () {58 vars in 1253 bytes} [Thu May 19 06:37:36 2022] DELETE /compute/v2.1/os-snapshots/5b260de0-4daf-44ea-b829-1a73d382c832 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 06:37:37.083992 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c12e8225-1e71-48b7-b9ca-e2cc365034f9 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] Calling method '.version_select at 0x7f9aeada4940>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:37.121348 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c12e8225-1e71-48b7-b9ca-e2cc365034f9 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/5b260de0-4daf-44ea-b829-1a73d382c832" status: 200 len: 287 microversion: 2.1 time: 0.046395 May 19 06:37:37.122526 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 349/700] 10.222.0.65 () {58 vars in 1250 bytes} [Thu May 19 06:37:37 2022] GET /compute/v2.1/os-snapshots/5b260de0-4daf-44ea-b829-1a73d382c832 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:37:38.137540 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1bbfd730-c561-48e9-a330-796ddfa54215 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] Calling method '.version_select at 0x7f9aeb6dc310>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:38.167267 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-1bbfd730-c561-48e9-a330-796ddfa54215 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] HTTP exception thrown: Snapshot 5b260de0-4daf-44ea-b829-1a73d382c832 could not be found. May 19 06:37:38.169545 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1bbfd730-c561-48e9-a330-796ddfa54215 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] Request method failure captured: May 19 06:37:38.169545 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/os-snapshots/5b260de0-4daf-44ea-b829-1a73d382c832 HTTP/1.1 May 19 06:37:38.169545 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:37:38.169545 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:37:38.169545 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:37:38.169545 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 0 May 19 06:37:38.169545 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:37:38.169545 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:37:38.169545 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:37:38.169545 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:37:38.169545 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheWrQ4OcYNHiGyb5WWQ1L1XFHTF4pSZer5TZrekHNxCO8JPuifqHUCifUp7oymrzq0xpe2yK1Yok4u9MnSIWih038iNtOCmI3CNPQq5VCdVR_bdVgQO1GnAWp5vQCVghfRBCXGla8na0dT84MkElwzkabTcspotp-Ue-YSyUfnKm_Zg May 19 06:37:38.169545 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:37:38.169545 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:37:38.169545 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:37:38.169545 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:37:38.169545 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:37:38.169545 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:37:38.169545 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: 4a0a5b597c3743b1ac55fd40bd141ac7 May 19 06:37:38.169545 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-344985409 May 19 06:37:38.169545 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:37:38.169545 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:37:38.171263 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4a0a5b597c3743b1ac55fd40bd141ac7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4a0a5b597c3743b1ac55fd40bd141ac7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4a0a5b597c3743b1ac55fd40bd141ac7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4a0a5b597c3743b1ac55fd40bd141ac7", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:37:38.171263 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-VolumesSnapshotsTestJSON-344985409 May 19 06:37:38.171263 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: 4a0a5b597c3743b1ac55fd40bd141ac7 May 19 06:37:38.171263 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-344985409 May 19 06:37:38.171263 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-VolumesSnapshotsTestJSON-344985409-project May 19 06:37:38.171263 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:37:38.171263 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:37:38.171263 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: f99a5aaef1a446ec819ba675dd5d47dc May 19 06:37:38.171263 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-VolumesSnapshotsTestJSON-344985409-project May 19 06:37:38.171263 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: May 19 06:37:38.171263 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Snapshot 5b260de0-4daf-44ea-b829-1a73d382c832 could not be found. May 19 06:37:38.171263 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'id': '5b260de0-4daf-44ea-b829-1a73d382c832'} May 19 06:37:38.171263 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:37:38.172226 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:38.172226 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 19 06:37:38.172226 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 19 06:37:38.172226 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 19 06:37:38.172226 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 19 06:37:38.172226 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 19 06:37:38.172226 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 19 06:37:38.172226 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 06:37:38.172226 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 06:37:38.172226 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 06:37:38.172226 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 06:37:38.172226 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 06:37:38.172226 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 06:37:38.172226 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 06:37:38.172226 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 06:37:38.172226 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5b260de0-4daf-44ea-b829-1a73d382c832 could not be found. (HTTP 404) (Request-ID: req-c602e1ce-fabd-4141-9d57-9a3e4310f0e1) May 19 06:37:38.172226 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:38.172226 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:38.173638 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:38.173638 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:38.173638 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 19 06:37:38.173638 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 19 06:37:38.173638 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 06:37:38.173638 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 06:37:38.173638 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 19 06:37:38.173638 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 19 06:37:38.173638 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 06:37:38.173638 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 06:37:38.173638 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 19 06:37:38.173638 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 19 06:37:38.173638 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 19 06:37:38.173638 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 19 06:37:38.173638 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 19 06:37:38.173638 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 19 06:37:38.173638 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 06:37:38.173638 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 06:37:38.173638 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 06:37:38.174830 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 06:37:38.174830 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 06:37:38.174830 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 06:37:38.174830 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 06:37:38.174830 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 06:37:38.174830 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5b260de0-4daf-44ea-b829-1a73d382c832 could not be found. May 19 06:37:38.174830 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:38.174830 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:38.174830 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:38.174830 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:38.174830 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:38.174830 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:38.174830 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:37:38.174830 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:37:38.174830 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 06:37:38.174830 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 06:37:38.174830 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:37:38.174830 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:37:38.174830 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 19 06:37:38.174830 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:37:38.176153 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5b260de0-4daf-44ea-b829-1a73d382c832 could not be found. May 19 06:37:38.176153 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:38.176153 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:38.176153 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:38.176153 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:38.176153 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:38.176153 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:38.176153 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:37:38.176153 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:37:38.176153 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5b260de0-4daf-44ea-b829-1a73d382c832 could not be found. May 19 06:37:38.176153 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:38.176153 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1bbfd730-c561-48e9-a330-796ddfa54215 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] Returning 404 to user: Snapshot 5b260de0-4daf-44ea-b829-1a73d382c832 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:37:38.176153 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-1bbfd730-c561-48e9-a330-796ddfa54215 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/5b260de0-4daf-44ea-b829-1a73d382c832" status: 404 len: 111 microversion: 2.1 time: 0.039896 May 19 06:37:38.176153 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 352/701] 10.222.0.65 () {58 vars in 1250 bytes} [Thu May 19 06:37:38 2022] GET /compute/v2.1/os-snapshots/5b260de0-4daf-44ea-b829-1a73d382c832 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:37:38.180758 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6a795e0f-79a9-40b8-8d4b-e3afc0749422 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] Calling method '.version_select at 0x7f9aeac3dd30>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:38.255530 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6a795e0f-79a9-40b8-8d4b-e3afc0749422 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/91913c1a-e743-407b-a7b9-1ca3fda987d5" status: 202 len: 0 microversion: 2.1 time: 0.078859 May 19 06:37:38.256115 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 350/702] 10.222.0.65 () {58 vars in 1247 bytes} [Thu May 19 06:37:38 2022] DELETE /compute/v2.1/os-volumes/91913c1a-e743-407b-a7b9-1ca3fda987d5 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 06:37:38.266052 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-2f95b421-4713-42ca-9615-167d75bd468a tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] Calling method '.version_select at 0x7f9aeb472c10>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:38.322073 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-2f95b421-4713-42ca-9615-167d75bd468a tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/91913c1a-e743-407b-a7b9-1ca3fda987d5" status: 200 len: 344 microversion: 2.1 time: 0.060833 May 19 06:37:38.322678 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 353/703] 10.222.0.65 () {58 vars in 1244 bytes} [Thu May 19 06:37:38 2022] GET /compute/v2.1/os-volumes/91913c1a-e743-407b-a7b9-1ca3fda987d5 => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:37:39.336892 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0ee5bcdd-6a8a-449e-aa2e-f1c176347093 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] Calling method '.version_select at 0x7f9aeac460d0>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:39.372185 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-0ee5bcdd-6a8a-449e-aa2e-f1c176347093 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] HTTP exception thrown: Volume 91913c1a-e743-407b-a7b9-1ca3fda987d5 could not be found. May 19 06:37:39.374581 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0ee5bcdd-6a8a-449e-aa2e-f1c176347093 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] Request method failure captured: May 19 06:37:39.374581 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/os-volumes/91913c1a-e743-407b-a7b9-1ca3fda987d5 HTTP/1.1 May 19 06:37:39.374581 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept: application/json May 19 06:37:39.374581 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity May 19 06:37:39.374581 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Connection: close May 19 06:37:39.374581 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Length: 0 May 19 06:37:39.374581 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Type: application/json May 19 06:37:39.374581 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Host: 10.222.0.65 May 19 06:37:39.374581 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None May 19 06:37:39.374581 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 May 19 06:37:39.374581 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiheWrQ4OcYNHiGyb5WWQ1L1XFHTF4pSZer5TZrekHNxCO8JPuifqHUCifUp7oymrzq0xpe2yK1Yok4u9MnSIWih038iNtOCmI3CNPQq5VCdVR_bdVgQO1GnAWp5vQCVghfRBCXGla8na0dT84MkElwzkabTcspotp-Ue-YSyUfnKm_Zg May 19 06:37:39.374581 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Id: None May 19 06:37:39.374581 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Name: None May 19 06:37:39.374581 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed May 19 06:37:39.374581 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True May 19 06:37:39.374581 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default May 19 06:37:39.374581 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default May 19 06:37:39.374581 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Id: 4a0a5b597c3743b1ac55fd40bd141ac7 May 19 06:37:39.374581 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-344985409 May 19 06:37:39.374581 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Role: reader,member May 19 06:37:39.374581 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Roles: reader,member May 19 06:37:39.376291 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4a0a5b597c3743b1ac55fd40bd141ac7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4a0a5b597c3743b1ac55fd40bd141ac7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4a0a5b597c3743b1ac55fd40bd141ac7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4a0a5b597c3743b1ac55fd40bd141ac7", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:37:39.376291 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-VolumesSnapshotsTestJSON-344985409 May 19 06:37:39.376291 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Id: 4a0a5b597c3743b1ac55fd40bd141ac7 May 19 06:37:39.376291 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-344985409 May 19 06:37:39.376291 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User: tempest-VolumesSnapshotsTestJSON-344985409-project May 19 06:37:39.376291 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default May 19 06:37:39.376291 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default May 19 06:37:39.376291 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Id: f99a5aaef1a446ec819ba675dd5d47dc May 19 06:37:39.376291 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-VolumesSnapshotsTestJSON-344985409-project May 19 06:37:39.376291 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: method: May 19 06:37:39.376291 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: exception: Volume 91913c1a-e743-407b-a7b9-1ca3fda987d5 could not be found. May 19 06:37:39.376291 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: action_args: {'id': '91913c1a-e743-407b-a7b9-1ca3fda987d5'} May 19 06:37:39.376291 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:37:39.377323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:39.377323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 06:37:39.377323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 06:37:39.377323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 06:37:39.377323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 06:37:39.377323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 06:37:39.377323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 06:37:39.377323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 06:37:39.377323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 06:37:39.377323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 06:37:39.377323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 06:37:39.377323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 06:37:39.377323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 06:37:39.377323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 06:37:39.377323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 06:37:39.377323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 91913c1a-e743-407b-a7b9-1ca3fda987d5 could not be found. (HTTP 404) (Request-ID: req-8d32af00-0071-4363-9409-b58685972f18) May 19 06:37:39.377323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:39.377323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:39.377323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:39.378884 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:39.378884 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 06:37:39.378884 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 06:37:39.378884 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 06:37:39.378884 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 06:37:39.378884 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 06:37:39.378884 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 06:37:39.378884 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 06:37:39.378884 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 06:37:39.378884 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 06:37:39.378884 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 06:37:39.378884 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 06:37:39.378884 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 06:37:39.378884 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 06:37:39.378884 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 06:37:39.378884 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 06:37:39.378884 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 06:37:39.378884 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 06:37:39.378884 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 06:37:39.380375 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 06:37:39.380375 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 06:37:39.380375 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 06:37:39.380375 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 06:37:39.380375 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 91913c1a-e743-407b-a7b9-1ca3fda987d5 could not be found. May 19 06:37:39.380375 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:39.380375 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:39.380375 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:39.380375 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:39.380375 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:39.380375 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:39.380375 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:37:39.380375 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:37:39.380375 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 06:37:39.380375 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 06:37:39.380375 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:37:39.380375 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:37:39.380375 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 06:37:39.380375 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:37:39.381980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 91913c1a-e743-407b-a7b9-1ca3fda987d5 could not be found. May 19 06:37:39.381980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:39.381980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:39.381980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:39.381980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:39.381980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:39.381980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:39.381980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:37:39.381980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:37:39.381980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 91913c1a-e743-407b-a7b9-1ca3fda987d5 could not be found. May 19 06:37:39.381980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:39.381980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0ee5bcdd-6a8a-449e-aa2e-f1c176347093 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] Returning 404 to user: Volume 91913c1a-e743-407b-a7b9-1ca3fda987d5 could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:37:39.381980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0ee5bcdd-6a8a-449e-aa2e-f1c176347093 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/91913c1a-e743-407b-a7b9-1ca3fda987d5" status: 404 len: 109 microversion: 2.1 time: 0.044571 May 19 06:37:39.381980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 351/704] 10.222.0.65 () {58 vars in 1244 bytes} [Thu May 19 06:37:39 2022] GET /compute/v2.1/os-volumes/91913c1a-e743-407b-a7b9-1ca3fda987d5 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:37:39.396378 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6af0b91c-df4b-49de-a182-cac897c0b8da tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] Calling method '.version_select at 0x7f9aeb6bc0d0>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:39.433118 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-6af0b91c-df4b-49de-a182-cac897c0b8da tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] HTTP exception thrown: Volume 91913c1a-e743-407b-a7b9-1ca3fda987d5 could not be found. May 19 06:37:39.435178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6af0b91c-df4b-49de-a182-cac897c0b8da tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] Request method failure captured: May 19 06:37:39.435178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: DELETE /compute/v2.1/os-volumes/91913c1a-e743-407b-a7b9-1ca3fda987d5 HTTP/1.1 May 19 06:37:39.435178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:37:39.435178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:37:39.435178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:37:39.435178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 0 May 19 06:37:39.435178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:37:39.435178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:37:39.435178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:37:39.435178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:37:39.435178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheWrQ4OcYNHiGyb5WWQ1L1XFHTF4pSZer5TZrekHNxCO8JPuifqHUCifUp7oymrzq0xpe2yK1Yok4u9MnSIWih038iNtOCmI3CNPQq5VCdVR_bdVgQO1GnAWp5vQCVghfRBCXGla8na0dT84MkElwzkabTcspotp-Ue-YSyUfnKm_Zg May 19 06:37:39.435178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:37:39.435178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:37:39.435178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:37:39.435178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:37:39.435178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:37:39.435178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:37:39.435178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: 4a0a5b597c3743b1ac55fd40bd141ac7 May 19 06:37:39.435178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-344985409 May 19 06:37:39.435178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:37:39.435178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:37:39.437698 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4a0a5b597c3743b1ac55fd40bd141ac7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4a0a5b597c3743b1ac55fd40bd141ac7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4a0a5b597c3743b1ac55fd40bd141ac7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4a0a5b597c3743b1ac55fd40bd141ac7", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:37:39.437698 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-VolumesSnapshotsTestJSON-344985409 May 19 06:37:39.437698 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: 4a0a5b597c3743b1ac55fd40bd141ac7 May 19 06:37:39.437698 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-344985409 May 19 06:37:39.437698 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-VolumesSnapshotsTestJSON-344985409-project May 19 06:37:39.437698 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:37:39.437698 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:37:39.437698 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: f99a5aaef1a446ec819ba675dd5d47dc May 19 06:37:39.437698 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-VolumesSnapshotsTestJSON-344985409-project May 19 06:37:39.437698 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: May 19 06:37:39.437698 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Volume 91913c1a-e743-407b-a7b9-1ca3fda987d5 could not be found. May 19 06:37:39.437698 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'id': '91913c1a-e743-407b-a7b9-1ca3fda987d5'} May 19 06:37:39.437698 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:37:39.439279 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:39.439279 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 06:37:39.439279 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 06:37:39.439279 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 06:37:39.439279 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 06:37:39.439279 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 06:37:39.439279 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 06:37:39.439279 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 06:37:39.439279 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 06:37:39.439279 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 06:37:39.439279 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 06:37:39.439279 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 06:37:39.439279 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 06:37:39.439279 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 06:37:39.439279 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 06:37:39.439279 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 91913c1a-e743-407b-a7b9-1ca3fda987d5 could not be found. (HTTP 404) (Request-ID: req-46c8835b-41fb-44a7-bea0-e3e069413bec) May 19 06:37:39.439279 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:39.439279 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:39.439279 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:39.441183 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:39.441183 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 19 06:37:39.441183 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 19 06:37:39.441183 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 06:37:39.441183 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 06:37:39.441183 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 06:37:39.441183 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 06:37:39.441183 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 06:37:39.441183 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 06:37:39.441183 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 06:37:39.441183 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 06:37:39.441183 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 06:37:39.441183 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 06:37:39.441183 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 06:37:39.441183 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 06:37:39.441183 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 06:37:39.441183 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 06:37:39.441183 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 06:37:39.441183 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 06:37:39.442623 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 06:37:39.442623 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 06:37:39.442623 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 06:37:39.442623 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 06:37:39.442623 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 91913c1a-e743-407b-a7b9-1ca3fda987d5 could not be found. May 19 06:37:39.442623 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:39.442623 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:39.442623 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:39.442623 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:39.442623 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:39.442623 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:39.442623 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:37:39.442623 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:37:39.442623 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 06:37:39.442623 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 06:37:39.442623 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:37:39.442623 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:37:39.442623 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 19 06:37:39.442623 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:37:39.444142 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 91913c1a-e743-407b-a7b9-1ca3fda987d5 could not be found. May 19 06:37:39.444142 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:39.444142 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:39.444142 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:39.444142 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:39.444142 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:39.444142 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:39.444142 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:37:39.444142 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:37:39.444142 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 91913c1a-e743-407b-a7b9-1ca3fda987d5 could not be found. May 19 06:37:39.444142 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:37:39.444142 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6af0b91c-df4b-49de-a182-cac897c0b8da tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] Returning 404 to user: Volume 91913c1a-e743-407b-a7b9-1ca3fda987d5 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:37:39.444142 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6af0b91c-df4b-49de-a182-cac897c0b8da tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/91913c1a-e743-407b-a7b9-1ca3fda987d5" status: 404 len: 109 microversion: 2.1 time: 0.044673 May 19 06:37:39.444142 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 354/705] 10.222.0.65 () {58 vars in 1247 bytes} [Thu May 19 06:37:39 2022] DELETE /compute/v2.1/os-volumes/91913c1a-e743-407b-a7b9-1ca3fda987d5 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:37:39.452583 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7298169f-1ac4-4ac5-95ba-894ab32d2a24 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] Calling method '.version_select at 0x7f9aeac46040>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:39.484346 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-7298169f-1ac4-4ac5-95ba-894ab32d2a24 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] HTTP exception thrown: Volume 91913c1a-e743-407b-a7b9-1ca3fda987d5 could not be found. May 19 06:37:39.486809 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7298169f-1ac4-4ac5-95ba-894ab32d2a24 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] Request method failure captured: May 19 06:37:39.486809 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/os-volumes/91913c1a-e743-407b-a7b9-1ca3fda987d5 HTTP/1.1 May 19 06:37:39.486809 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept: application/json May 19 06:37:39.486809 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity May 19 06:37:39.486809 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Connection: close May 19 06:37:39.486809 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Length: 0 May 19 06:37:39.486809 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Type: application/json May 19 06:37:39.486809 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Host: 10.222.0.65 May 19 06:37:39.486809 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None May 19 06:37:39.486809 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 May 19 06:37:39.486809 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiheWrQ4OcYNHiGyb5WWQ1L1XFHTF4pSZer5TZrekHNxCO8JPuifqHUCifUp7oymrzq0xpe2yK1Yok4u9MnSIWih038iNtOCmI3CNPQq5VCdVR_bdVgQO1GnAWp5vQCVghfRBCXGla8na0dT84MkElwzkabTcspotp-Ue-YSyUfnKm_Zg May 19 06:37:39.486809 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Id: None May 19 06:37:39.486809 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Name: None May 19 06:37:39.486809 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed May 19 06:37:39.486809 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True May 19 06:37:39.486809 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default May 19 06:37:39.486809 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default May 19 06:37:39.486809 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Id: 4a0a5b597c3743b1ac55fd40bd141ac7 May 19 06:37:39.486809 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-344985409 May 19 06:37:39.486809 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Role: reader,member May 19 06:37:39.486809 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Roles: reader,member May 19 06:37:39.488450 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4a0a5b597c3743b1ac55fd40bd141ac7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4a0a5b597c3743b1ac55fd40bd141ac7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4a0a5b597c3743b1ac55fd40bd141ac7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4a0a5b597c3743b1ac55fd40bd141ac7", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:37:39.488450 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-VolumesSnapshotsTestJSON-344985409 May 19 06:37:39.488450 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Id: 4a0a5b597c3743b1ac55fd40bd141ac7 May 19 06:37:39.488450 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-344985409 May 19 06:37:39.488450 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User: tempest-VolumesSnapshotsTestJSON-344985409-project May 19 06:37:39.488450 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default May 19 06:37:39.488450 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default May 19 06:37:39.488450 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Id: f99a5aaef1a446ec819ba675dd5d47dc May 19 06:37:39.488450 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-VolumesSnapshotsTestJSON-344985409-project May 19 06:37:39.488450 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: method: May 19 06:37:39.488450 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: exception: Volume 91913c1a-e743-407b-a7b9-1ca3fda987d5 could not be found. May 19 06:37:39.488450 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: action_args: {'id': '91913c1a-e743-407b-a7b9-1ca3fda987d5'} May 19 06:37:39.488450 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:37:39.489417 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:39.489417 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 06:37:39.489417 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 06:37:39.489417 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 06:37:39.489417 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 06:37:39.489417 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 06:37:39.489417 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 06:37:39.489417 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 06:37:39.489417 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 06:37:39.489417 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 06:37:39.489417 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 06:37:39.489417 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 06:37:39.489417 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 06:37:39.489417 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 06:37:39.489417 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 06:37:39.489417 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 91913c1a-e743-407b-a7b9-1ca3fda987d5 could not be found. (HTTP 404) (Request-ID: req-737b0b41-3c23-4453-ad64-b57cb7ddaa6c) May 19 06:37:39.489417 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:39.489417 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:39.489417 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:39.490768 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:39.490768 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 06:37:39.490768 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 06:37:39.490768 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 06:37:39.490768 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 06:37:39.490768 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 06:37:39.490768 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 06:37:39.490768 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 06:37:39.490768 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 06:37:39.490768 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 06:37:39.490768 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 06:37:39.490768 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 06:37:39.490768 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 06:37:39.490768 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 06:37:39.490768 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 06:37:39.490768 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 06:37:39.490768 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 06:37:39.490768 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 06:37:39.490768 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 06:37:39.492123 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 06:37:39.492123 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 06:37:39.492123 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 06:37:39.492123 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 06:37:39.492123 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 91913c1a-e743-407b-a7b9-1ca3fda987d5 could not be found. May 19 06:37:39.492123 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:39.492123 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:39.492123 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:39.492123 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:39.492123 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:39.492123 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:39.492123 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:37:39.492123 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:37:39.492123 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 06:37:39.492123 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 06:37:39.492123 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:37:39.492123 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:37:39.492123 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 06:37:39.492123 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:37:39.493542 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 91913c1a-e743-407b-a7b9-1ca3fda987d5 could not be found. May 19 06:37:39.493542 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:39.493542 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:37:39.493542 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:39.493542 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:37:39.493542 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:37:39.493542 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:37:39.493542 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:37:39.493542 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:37:39.493542 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 91913c1a-e743-407b-a7b9-1ca3fda987d5 could not be found. May 19 06:37:39.493542 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:37:39.493542 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7298169f-1ac4-4ac5-95ba-894ab32d2a24 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] Returning 404 to user: Volume 91913c1a-e743-407b-a7b9-1ca3fda987d5 could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:37:39.493542 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7298169f-1ac4-4ac5-95ba-894ab32d2a24 tempest-VolumesSnapshotsTestJSON-344985409 tempest-VolumesSnapshotsTestJSON-344985409-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/91913c1a-e743-407b-a7b9-1ca3fda987d5" status: 404 len: 109 microversion: 2.1 time: 0.044182 May 19 06:37:39.493542 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 352/706] 10.222.0.65 () {58 vars in 1244 bytes} [Thu May 19 06:37:39 2022] GET /compute/v2.1/os-volumes/91913c1a-e743-407b-a7b9-1ca3fda987d5 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:37:41.832563 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e8a58dde-4291-4fe9-abad-757d8379c87c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:41.834768 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e8a58dde-4291-4fe9-abad-757d8379c87c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:41.850069 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e8a58dde-4291-4fe9-abad-757d8379c87c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:41.851338 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e8a58dde-4291-4fe9-abad-757d8379c87c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:41.853465 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e8a58dde-4291-4fe9-abad-757d8379c87c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:41.855295 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e8a58dde-4291-4fe9-abad-757d8379c87c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:41.898272 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e8a58dde-4291-4fe9-abad-757d8379c87c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454/ips" status: 200 len: 151 microversion: 2.20 time: 0.073441 May 19 06:37:41.899459 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 355/707] 10.222.0.65 () {60 vars in 1288 bytes} [Thu May 19 06:37:41 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454/ips => generated 151 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 06:37:44.047024 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-cf739c01-bbc1-4aa4-b039-2a6a3cea520e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:37:44.047024 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-cf739c01-bbc1-4aa4-b039-2a6a3cea520e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:44.054783 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cf739c01-bbc1-4aa4-b039-2a6a3cea520e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:44.055426 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cf739c01-bbc1-4aa4-b039-2a6a3cea520e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:44.056329 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cf739c01-bbc1-4aa4-b039-2a6a3cea520e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:44.056865 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cf739c01-bbc1-4aa4-b039-2a6a3cea520e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:44.087773 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-cf739c01-bbc1-4aa4-b039-2a6a3cea520e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lazy-loading 'flavor' on Instance uuid 06323e6f-7b35-407f-aecf-5435fa013454 {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:37:44.503344 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-cf739c01-bbc1-4aa4-b039-2a6a3cea520e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "POST /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454/action" status: 202 len: 0 microversion: 2.20 time: 0.462270 May 19 06:37:44.503981 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 353/708] 10.222.0.65 () {62 vars in 1318 bytes} [Thu May 19 06:37:44 2022] POST /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 19 06:37:44.519507 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-41b3ced3-79c7-4c4e-80f9-1f68c7f3a04a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:44.522562 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-41b3ced3-79c7-4c4e-80f9-1f68c7f3a04a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:44.541414 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-41b3ced3-79c7-4c4e-80f9-1f68c7f3a04a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:44.542589 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-41b3ced3-79c7-4c4e-80f9-1f68c7f3a04a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:44.544528 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-41b3ced3-79c7-4c4e-80f9-1f68c7f3a04a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:44.545682 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-41b3ced3-79c7-4c4e-80f9-1f68c7f3a04a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:44.783516 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-41b3ced3-79c7-4c4e-80f9-1f68c7f3a04a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:44.793699 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-41b3ced3-79c7-4c4e-80f9-1f68c7f3a04a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:44.795266 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-41b3ced3-79c7-4c4e-80f9-1f68c7f3a04a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:44.796466 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-41b3ced3-79c7-4c4e-80f9-1f68c7f3a04a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1723 microversion: 2.20 time: 0.286264 May 19 06:37:44.797018 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 356/709] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:37:44 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 06:37:45.829530 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-610420ba-0af2-4000-b4b5-f062ba31834a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:45.831846 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-610420ba-0af2-4000-b4b5-f062ba31834a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:45.844546 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-610420ba-0af2-4000-b4b5-f062ba31834a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:45.845795 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-610420ba-0af2-4000-b4b5-f062ba31834a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:45.847184 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-610420ba-0af2-4000-b4b5-f062ba31834a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:45.847954 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-610420ba-0af2-4000-b4b5-f062ba31834a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:46.033776 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-610420ba-0af2-4000-b4b5-f062ba31834a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:46.042904 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-610420ba-0af2-4000-b4b5-f062ba31834a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:46.044567 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-610420ba-0af2-4000-b4b5-f062ba31834a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:46.046505 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-610420ba-0af2-4000-b4b5-f062ba31834a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1723 microversion: 2.20 time: 0.225336 May 19 06:37:46.047471 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 354/710] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:37:45 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:37:47.080457 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3ddb3cf7-458f-4469-9ae6-9bc511205c6c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:47.081187 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-3ddb3cf7-458f-4469-9ae6-9bc511205c6c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:47.089827 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3ddb3cf7-458f-4469-9ae6-9bc511205c6c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:47.090283 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3ddb3cf7-458f-4469-9ae6-9bc511205c6c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:47.091103 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3ddb3cf7-458f-4469-9ae6-9bc511205c6c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:47.091547 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3ddb3cf7-458f-4469-9ae6-9bc511205c6c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:47.255501 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3ddb3cf7-458f-4469-9ae6-9bc511205c6c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:47.265557 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3ddb3cf7-458f-4469-9ae6-9bc511205c6c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:47.267089 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3ddb3cf7-458f-4469-9ae6-9bc511205c6c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:47.268261 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-3ddb3cf7-458f-4469-9ae6-9bc511205c6c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1723 microversion: 2.20 time: 0.192938 May 19 06:37:47.268820 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 357/711] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:37:47 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:37:48.289710 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-470004dc-890f-4c6a-8dc1-d5f28627e629 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:48.290966 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-470004dc-890f-4c6a-8dc1-d5f28627e629 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:48.297481 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-470004dc-890f-4c6a-8dc1-d5f28627e629 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:48.298192 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-470004dc-890f-4c6a-8dc1-d5f28627e629 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:48.298958 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-470004dc-890f-4c6a-8dc1-d5f28627e629 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:48.299385 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-470004dc-890f-4c6a-8dc1-d5f28627e629 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:48.454506 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-470004dc-890f-4c6a-8dc1-d5f28627e629 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:48.463290 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-470004dc-890f-4c6a-8dc1-d5f28627e629 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:48.464877 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-470004dc-890f-4c6a-8dc1-d5f28627e629 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:48.466100 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-470004dc-890f-4c6a-8dc1-d5f28627e629 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1723 microversion: 2.20 time: 0.181734 May 19 06:37:48.466657 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 355/712] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:37:48 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:37:49.487385 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-27a27ba1-6911-4020-867f-bd3dad41c562 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:49.488013 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-27a27ba1-6911-4020-867f-bd3dad41c562 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:49.497513 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-27a27ba1-6911-4020-867f-bd3dad41c562 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:49.498245 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-27a27ba1-6911-4020-867f-bd3dad41c562 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:49.499195 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-27a27ba1-6911-4020-867f-bd3dad41c562 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:49.499761 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-27a27ba1-6911-4020-867f-bd3dad41c562 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:49.650697 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-27a27ba1-6911-4020-867f-bd3dad41c562 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:49.659090 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-27a27ba1-6911-4020-867f-bd3dad41c562 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:49.660638 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-27a27ba1-6911-4020-867f-bd3dad41c562 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:49.661874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-27a27ba1-6911-4020-867f-bd3dad41c562 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1723 microversion: 2.20 time: 0.180262 May 19 06:37:49.662586 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 358/713] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:37:49 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:37:50.685991 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3e3e5916-66d2-4819-af7a-6d8b540db3ca tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:50.686829 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3e3e5916-66d2-4819-af7a-6d8b540db3ca tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:50.694941 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3e3e5916-66d2-4819-af7a-6d8b540db3ca tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:50.695637 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3e3e5916-66d2-4819-af7a-6d8b540db3ca tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:50.696725 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3e3e5916-66d2-4819-af7a-6d8b540db3ca tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:50.697362 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3e3e5916-66d2-4819-af7a-6d8b540db3ca tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:50.889081 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3e3e5916-66d2-4819-af7a-6d8b540db3ca tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:50.898318 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3e3e5916-66d2-4819-af7a-6d8b540db3ca tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:50.899913 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3e3e5916-66d2-4819-af7a-6d8b540db3ca tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:50.902173 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3e3e5916-66d2-4819-af7a-6d8b540db3ca tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1723 microversion: 2.20 time: 0.222327 May 19 06:37:50.902762 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 356/714] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:37:50 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:37:51.939929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-9f9f1936-1bdf-4de6-893a-e5085863e87d tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:51.941996 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-9f9f1936-1bdf-4de6-893a-e5085863e87d tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:51.955512 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9f9f1936-1bdf-4de6-893a-e5085863e87d tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:51.956324 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9f9f1936-1bdf-4de6-893a-e5085863e87d tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:51.957984 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9f9f1936-1bdf-4de6-893a-e5085863e87d tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:51.958800 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9f9f1936-1bdf-4de6-893a-e5085863e87d tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:52.249967 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9f9f1936-1bdf-4de6-893a-e5085863e87d tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:52.261935 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9f9f1936-1bdf-4de6-893a-e5085863e87d tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:52.265140 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9f9f1936-1bdf-4de6-893a-e5085863e87d tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:52.267963 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-9f9f1936-1bdf-4de6-893a-e5085863e87d tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1723 microversion: 2.20 time: 0.337759 May 19 06:37:52.268994 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 359/715] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:37:51 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1723 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:37:53.288734 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0233b7d6-6ef9-473a-9a10-fea1a54120b1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:53.289783 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0233b7d6-6ef9-473a-9a10-fea1a54120b1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:53.300388 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0233b7d6-6ef9-473a-9a10-fea1a54120b1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:53.301092 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0233b7d6-6ef9-473a-9a10-fea1a54120b1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:53.302226 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0233b7d6-6ef9-473a-9a10-fea1a54120b1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:53.302972 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0233b7d6-6ef9-473a-9a10-fea1a54120b1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:53.592105 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0233b7d6-6ef9-473a-9a10-fea1a54120b1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:53.608934 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0233b7d6-6ef9-473a-9a10-fea1a54120b1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:53.611274 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0233b7d6-6ef9-473a-9a10-fea1a54120b1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:53.613806 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0233b7d6-6ef9-473a-9a10-fea1a54120b1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1723 microversion: 2.20 time: 0.330724 May 19 06:37:53.614853 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 357/716] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:37:53 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1723 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:37:54.646207 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ff0fbb49-59e1-4da6-b0c8-5639ee82c13b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:54.647758 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ff0fbb49-59e1-4da6-b0c8-5639ee82c13b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:54.656715 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ff0fbb49-59e1-4da6-b0c8-5639ee82c13b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:54.657451 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ff0fbb49-59e1-4da6-b0c8-5639ee82c13b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:54.658950 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ff0fbb49-59e1-4da6-b0c8-5639ee82c13b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:54.659901 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ff0fbb49-59e1-4da6-b0c8-5639ee82c13b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:54.918994 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ff0fbb49-59e1-4da6-b0c8-5639ee82c13b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:54.931177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ff0fbb49-59e1-4da6-b0c8-5639ee82c13b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:54.933422 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ff0fbb49-59e1-4da6-b0c8-5639ee82c13b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:54.934987 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ff0fbb49-59e1-4da6-b0c8-5639ee82c13b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1723 microversion: 2.20 time: 0.297532 May 19 06:37:54.936226 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 360/717] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:37:54 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:37:55.961849 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-02801dd0-830f-43fd-bc56-8cf93765cfda tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:55.962494 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-02801dd0-830f-43fd-bc56-8cf93765cfda tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:55.971839 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-02801dd0-830f-43fd-bc56-8cf93765cfda tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:55.971839 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-02801dd0-830f-43fd-bc56-8cf93765cfda tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:55.972898 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-02801dd0-830f-43fd-bc56-8cf93765cfda tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:55.973058 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-02801dd0-830f-43fd-bc56-8cf93765cfda tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:56.164314 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-02801dd0-830f-43fd-bc56-8cf93765cfda tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:56.173989 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-02801dd0-830f-43fd-bc56-8cf93765cfda tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:56.175486 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-02801dd0-830f-43fd-bc56-8cf93765cfda tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:56.176740 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-02801dd0-830f-43fd-bc56-8cf93765cfda tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1744 microversion: 2.20 time: 0.218817 May 19 06:37:56.177407 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 358/718] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:37:55 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1744 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:37:57.245881 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-56c3c314-ee74-43c7-a04a-f85b23809de8 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:57.247099 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-56c3c314-ee74-43c7-a04a-f85b23809de8 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:57.264632 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-56c3c314-ee74-43c7-a04a-f85b23809de8 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:57.265181 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-56c3c314-ee74-43c7-a04a-f85b23809de8 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:57.266564 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-56c3c314-ee74-43c7-a04a-f85b23809de8 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:57.268020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-56c3c314-ee74-43c7-a04a-f85b23809de8 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:57.484238 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-56c3c314-ee74-43c7-a04a-f85b23809de8 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:57.497834 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-56c3c314-ee74-43c7-a04a-f85b23809de8 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:57.499425 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-56c3c314-ee74-43c7-a04a-f85b23809de8 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:57.500646 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-56c3c314-ee74-43c7-a04a-f85b23809de8 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1739 microversion: 2.20 time: 0.308320 May 19 06:37:57.501224 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 361/719] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:37:57 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1739 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:37:58.530499 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-aa34061e-7788-4e0a-ae33-ea84601e0588 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:58.531550 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-aa34061e-7788-4e0a-ae33-ea84601e0588 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:58.555203 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-aa34061e-7788-4e0a-ae33-ea84601e0588 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:58.556766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-aa34061e-7788-4e0a-ae33-ea84601e0588 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:58.559514 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-aa34061e-7788-4e0a-ae33-ea84601e0588 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:58.560605 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-aa34061e-7788-4e0a-ae33-ea84601e0588 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:58.899219 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-aa34061e-7788-4e0a-ae33-ea84601e0588 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:58.911536 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-aa34061e-7788-4e0a-ae33-ea84601e0588 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:58.913489 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-aa34061e-7788-4e0a-ae33-ea84601e0588 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:37:58.914987 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-aa34061e-7788-4e0a-ae33-ea84601e0588 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1739 microversion: 2.20 time: 0.392294 May 19 06:37:58.916131 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 359/720] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:37:58 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1739 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:37:58.954996 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-3aa11777-b762-45c8-a68c-d7b23e144644 req-2a041af0-97f2-4575-89bd-89c6bbb44665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06323e6f-7b35-407f-aecf-5435fa013454", "name": "network-vif-plugged", "status": "completed", "tag": "b967f972-267a-488a-a383-8186a8a77201"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:37:58.981826 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-3aa11777-b762-45c8-a68c-d7b23e144644 req-2a041af0-97f2-4575-89bd-89c6bbb44665 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:58.982279 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-3aa11777-b762-45c8-a68c-d7b23e144644 req-2a041af0-97f2-4575-89bd-89c6bbb44665 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:59.014942 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-3aa11777-b762-45c8-a68c-d7b23e144644 req-2a041af0-97f2-4575-89bd-89c6bbb44665 service nova] Creating event network-vif-plugged:b967f972-267a-488a-a383-8186a8a77201 for instance 06323e6f-7b35-407f-aecf-5435fa013454 on hv-cinder-83699 May 19 06:37:59.022898 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-3aa11777-b762-45c8-a68c-d7b23e144644 req-2a041af0-97f2-4575-89bd-89c6bbb44665 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072570 May 19 06:37:59.023812 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 362/721] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:37:59.939632 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9296b95d-3429-4ef3-b45a-b2c4657dac96 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:37:59.941366 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9296b95d-3429-4ef3-b45a-b2c4657dac96 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:37:59.951784 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9296b95d-3429-4ef3-b45a-b2c4657dac96 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:59.953102 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9296b95d-3429-4ef3-b45a-b2c4657dac96 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:37:59.954289 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9296b95d-3429-4ef3-b45a-b2c4657dac96 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:37:59.954958 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9296b95d-3429-4ef3-b45a-b2c4657dac96 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:00.250663 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9296b95d-3429-4ef3-b45a-b2c4657dac96 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:00.269977 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9296b95d-3429-4ef3-b45a-b2c4657dac96 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:00.273622 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9296b95d-3429-4ef3-b45a-b2c4657dac96 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:00.278103 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9296b95d-3429-4ef3-b45a-b2c4657dac96 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1739 microversion: 2.20 time: 0.341446 May 19 06:38:00.279060 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 360/722] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:37:59 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1739 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:38:01.302254 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b4d980f1-b138-4b89-95a9-890d08106d51 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:01.302627 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b4d980f1-b138-4b89-95a9-890d08106d51 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:01.316867 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b4d980f1-b138-4b89-95a9-890d08106d51 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:01.318286 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b4d980f1-b138-4b89-95a9-890d08106d51 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:01.349632 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b4d980f1-b138-4b89-95a9-890d08106d51 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:01.352033 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b4d980f1-b138-4b89-95a9-890d08106d51 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:01.623174 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b4d980f1-b138-4b89-95a9-890d08106d51 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:01.634603 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b4d980f1-b138-4b89-95a9-890d08106d51 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:01.636287 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b4d980f1-b138-4b89-95a9-890d08106d51 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:01.644423 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b4d980f1-b138-4b89-95a9-890d08106d51 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1739 microversion: 2.20 time: 0.346786 May 19 06:38:01.670753 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 363/723] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:01 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1739 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:38:02.678829 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e120aade-9cdf-48f9-85d3-ac3bd5ef31ec tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:02.679656 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e120aade-9cdf-48f9-85d3-ac3bd5ef31ec tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:02.692361 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e120aade-9cdf-48f9-85d3-ac3bd5ef31ec tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:02.692803 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e120aade-9cdf-48f9-85d3-ac3bd5ef31ec tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:02.694045 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e120aade-9cdf-48f9-85d3-ac3bd5ef31ec tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:02.694485 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e120aade-9cdf-48f9-85d3-ac3bd5ef31ec tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:02.975584 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e120aade-9cdf-48f9-85d3-ac3bd5ef31ec tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:03.001424 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e120aade-9cdf-48f9-85d3-ac3bd5ef31ec tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:03.006095 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e120aade-9cdf-48f9-85d3-ac3bd5ef31ec tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:03.009235 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e120aade-9cdf-48f9-85d3-ac3bd5ef31ec tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1739 microversion: 2.20 time: 0.334116 May 19 06:38:03.023395 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 361/724] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:02 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1739 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:38:04.042502 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a679ebff-b105-4989-b86d-e4d0a5bcd0c3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:04.043627 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a679ebff-b105-4989-b86d-e4d0a5bcd0c3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:04.067511 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a679ebff-b105-4989-b86d-e4d0a5bcd0c3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:04.070896 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a679ebff-b105-4989-b86d-e4d0a5bcd0c3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:04.082402 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a679ebff-b105-4989-b86d-e4d0a5bcd0c3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:04.082972 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a679ebff-b105-4989-b86d-e4d0a5bcd0c3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:04.295052 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a679ebff-b105-4989-b86d-e4d0a5bcd0c3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:04.307037 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a679ebff-b105-4989-b86d-e4d0a5bcd0c3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:04.321591 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a679ebff-b105-4989-b86d-e4d0a5bcd0c3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:04.327738 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a679ebff-b105-4989-b86d-e4d0a5bcd0c3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1739 microversion: 2.20 time: 0.291142 May 19 06:38:04.328530 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 364/725] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:04 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1739 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:38:05.368041 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-891401cd-f4b2-4579-a190-d69c115c7ab1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:05.369024 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-891401cd-f4b2-4579-a190-d69c115c7ab1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:05.392048 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-891401cd-f4b2-4579-a190-d69c115c7ab1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:05.394361 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-891401cd-f4b2-4579-a190-d69c115c7ab1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:05.396497 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-891401cd-f4b2-4579-a190-d69c115c7ab1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:05.397266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-891401cd-f4b2-4579-a190-d69c115c7ab1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:05.639375 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-891401cd-f4b2-4579-a190-d69c115c7ab1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:05.651916 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-891401cd-f4b2-4579-a190-d69c115c7ab1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:05.656660 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-891401cd-f4b2-4579-a190-d69c115c7ab1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:05.658174 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-891401cd-f4b2-4579-a190-d69c115c7ab1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1739 microversion: 2.20 time: 0.301117 May 19 06:38:05.670053 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 362/726] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:05 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1739 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:38:06.689019 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b91c6e8d-ba1d-4498-a0f1-1a6dc767a480 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:06.692804 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b91c6e8d-ba1d-4498-a0f1-1a6dc767a480 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:06.703307 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=21 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:38:06.714775 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b91c6e8d-ba1d-4498-a0f1-1a6dc767a480 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:06.717174 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b91c6e8d-ba1d-4498-a0f1-1a6dc767a480 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:06.720109 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b91c6e8d-ba1d-4498-a0f1-1a6dc767a480 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:06.721958 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b91c6e8d-ba1d-4498-a0f1-1a6dc767a480 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:06.737740 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=55 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:38:07.147809 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b91c6e8d-ba1d-4498-a0f1-1a6dc767a480 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:07.169801 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b91c6e8d-ba1d-4498-a0f1-1a6dc767a480 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:07.175154 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b91c6e8d-ba1d-4498-a0f1-1a6dc767a480 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:07.177928 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b91c6e8d-ba1d-4498-a0f1-1a6dc767a480 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1739 microversion: 2.20 time: 0.500729 May 19 06:38:07.179217 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 365/727] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:06 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1739 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:38:08.202290 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c74f4e7d-7fa0-46b0-91f5-6c102acb0e4a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:08.203277 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c74f4e7d-7fa0-46b0-91f5-6c102acb0e4a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:08.208255 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=21 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:38:08.224511 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c74f4e7d-7fa0-46b0-91f5-6c102acb0e4a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:08.225689 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c74f4e7d-7fa0-46b0-91f5-6c102acb0e4a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:08.227864 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c74f4e7d-7fa0-46b0-91f5-6c102acb0e4a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:08.230853 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c74f4e7d-7fa0-46b0-91f5-6c102acb0e4a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:08.243184 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:38:08.500373 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c74f4e7d-7fa0-46b0-91f5-6c102acb0e4a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:08.526571 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c74f4e7d-7fa0-46b0-91f5-6c102acb0e4a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:08.534574 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c74f4e7d-7fa0-46b0-91f5-6c102acb0e4a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:08.538974 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c74f4e7d-7fa0-46b0-91f5-6c102acb0e4a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1739 microversion: 2.20 time: 0.342526 May 19 06:38:08.555666 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 363/728] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:08 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1739 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:38:09.565238 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-883ef7b1-1d36-4deb-ac4d-4eea23c64a20 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:09.567806 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-883ef7b1-1d36-4deb-ac4d-4eea23c64a20 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:09.579013 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-883ef7b1-1d36-4deb-ac4d-4eea23c64a20 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:09.580350 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-883ef7b1-1d36-4deb-ac4d-4eea23c64a20 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:09.581814 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-883ef7b1-1d36-4deb-ac4d-4eea23c64a20 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:09.582515 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-883ef7b1-1d36-4deb-ac4d-4eea23c64a20 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:09.798931 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-883ef7b1-1d36-4deb-ac4d-4eea23c64a20 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:09.841975 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-883ef7b1-1d36-4deb-ac4d-4eea23c64a20 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:09.846288 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-883ef7b1-1d36-4deb-ac4d-4eea23c64a20 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:09.848647 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-883ef7b1-1d36-4deb-ac4d-4eea23c64a20 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1739 microversion: 2.20 time: 0.287580 May 19 06:38:09.850620 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 366/729] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:09 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1739 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:38:10.883469 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-be4c1732-6ad5-4a5d-beb6-534130f8454e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:10.884504 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-be4c1732-6ad5-4a5d-beb6-534130f8454e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:10.893015 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-be4c1732-6ad5-4a5d-beb6-534130f8454e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:10.893510 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-be4c1732-6ad5-4a5d-beb6-534130f8454e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:10.894323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-be4c1732-6ad5-4a5d-beb6-534130f8454e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:10.894935 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-be4c1732-6ad5-4a5d-beb6-534130f8454e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:11.164944 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-be4c1732-6ad5-4a5d-beb6-534130f8454e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:11.175183 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-be4c1732-6ad5-4a5d-beb6-534130f8454e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:11.177132 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-be4c1732-6ad5-4a5d-beb6-534130f8454e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:11.178641 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-be4c1732-6ad5-4a5d-beb6-534130f8454e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1739 microversion: 2.20 time: 0.299042 May 19 06:38:11.191885 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 364/730] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:10 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1739 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 06:38:12.204235 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d49d5dcc-395d-41c7-8345-659b15cffcf2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:12.205456 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d49d5dcc-395d-41c7-8345-659b15cffcf2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:12.214451 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d49d5dcc-395d-41c7-8345-659b15cffcf2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:12.215338 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d49d5dcc-395d-41c7-8345-659b15cffcf2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:12.216477 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d49d5dcc-395d-41c7-8345-659b15cffcf2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:12.217065 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d49d5dcc-395d-41c7-8345-659b15cffcf2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:12.542581 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d49d5dcc-395d-41c7-8345-659b15cffcf2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:12.554079 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d49d5dcc-395d-41c7-8345-659b15cffcf2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:12.556235 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d49d5dcc-395d-41c7-8345-659b15cffcf2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:12.557998 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d49d5dcc-395d-41c7-8345-659b15cffcf2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1721 microversion: 2.20 time: 0.358644 May 19 06:38:12.566293 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 367/731] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:12 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1721 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 06:38:13.582016 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-21b75aeb-4c28-4365-8ca2-eaebbd62ff8c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:13.583240 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-21b75aeb-4c28-4365-8ca2-eaebbd62ff8c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:13.591910 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-21b75aeb-4c28-4365-8ca2-eaebbd62ff8c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:13.592246 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-21b75aeb-4c28-4365-8ca2-eaebbd62ff8c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:13.593221 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-21b75aeb-4c28-4365-8ca2-eaebbd62ff8c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:13.593954 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-21b75aeb-4c28-4365-8ca2-eaebbd62ff8c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:13.788754 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-21b75aeb-4c28-4365-8ca2-eaebbd62ff8c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:13.798920 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-21b75aeb-4c28-4365-8ca2-eaebbd62ff8c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:13.800693 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-21b75aeb-4c28-4365-8ca2-eaebbd62ff8c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:13.802143 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-21b75aeb-4c28-4365-8ca2-eaebbd62ff8c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1721 microversion: 2.20 time: 0.228113 May 19 06:38:13.802990 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 365/732] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:13 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:38:14.761994 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-c041cdb9-2752-4817-8494-8517a991d5be req-39356c6f-a89d-4e78-8a90-4f1994fc42d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06323e6f-7b35-407f-aecf-5435fa013454", "name": "network-vif-unplugged", "status": "completed", "tag": "b967f972-267a-488a-a383-8186a8a77201"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:38:14.791110 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-c041cdb9-2752-4817-8494-8517a991d5be req-39356c6f-a89d-4e78-8a90-4f1994fc42d9 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:14.791900 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-c041cdb9-2752-4817-8494-8517a991d5be req-39356c6f-a89d-4e78-8a90-4f1994fc42d9 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:14.828517 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e12fc42e-4e63-446e-8421-11cdb2ae4761 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:14.841109 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e12fc42e-4e63-446e-8421-11cdb2ae4761 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:14.864437 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e12fc42e-4e63-446e-8421-11cdb2ae4761 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:14.865236 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e12fc42e-4e63-446e-8421-11cdb2ae4761 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:14.868146 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-c041cdb9-2752-4817-8494-8517a991d5be req-39356c6f-a89d-4e78-8a90-4f1994fc42d9 service nova] Creating event network-vif-unplugged:b967f972-267a-488a-a383-8186a8a77201 for instance 06323e6f-7b35-407f-aecf-5435fa013454 on hv-cinder-83699 May 19 06:38:14.871095 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e12fc42e-4e63-446e-8421-11cdb2ae4761 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:14.874311 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e12fc42e-4e63-446e-8421-11cdb2ae4761 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:14.890475 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-c041cdb9-2752-4817-8494-8517a991d5be req-39356c6f-a89d-4e78-8a90-4f1994fc42d9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.140576 May 19 06:38:14.891883 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 368/733] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:38:15.149694 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e12fc42e-4e63-446e-8421-11cdb2ae4761 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:15.166033 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e12fc42e-4e63-446e-8421-11cdb2ae4761 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:15.169441 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e12fc42e-4e63-446e-8421-11cdb2ae4761 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:15.171780 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e12fc42e-4e63-446e-8421-11cdb2ae4761 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1721 microversion: 2.20 time: 0.351334 May 19 06:38:15.179359 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 366/734] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:14 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1721 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 06:38:16.195851 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-691b3b5c-c19e-4ef2-8b80-418e7f1fb1d9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:16.196717 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-691b3b5c-c19e-4ef2-8b80-418e7f1fb1d9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:16.216654 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-691b3b5c-c19e-4ef2-8b80-418e7f1fb1d9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:16.217116 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-691b3b5c-c19e-4ef2-8b80-418e7f1fb1d9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:16.217951 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-691b3b5c-c19e-4ef2-8b80-418e7f1fb1d9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:16.218389 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-691b3b5c-c19e-4ef2-8b80-418e7f1fb1d9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:16.555507 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-691b3b5c-c19e-4ef2-8b80-418e7f1fb1d9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:16.572614 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-691b3b5c-c19e-4ef2-8b80-418e7f1fb1d9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:16.575608 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-691b3b5c-c19e-4ef2-8b80-418e7f1fb1d9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:16.577571 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-691b3b5c-c19e-4ef2-8b80-418e7f1fb1d9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1724 microversion: 2.20 time: 0.387091 May 19 06:38:16.578796 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 369/735] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:16 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1724 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 06:38:16.610963 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-72f908e8-5158-4c8a-91fd-764ce76c57cb tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf9ce5e4-ba8f-4793-9c07-ade448e5676f"}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:38:16.614013 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-72f908e8-5158-4c8a-91fd-764ce76c57cb tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:16.627564 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-72f908e8-5158-4c8a-91fd-764ce76c57cb tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:16.628702 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-72f908e8-5158-4c8a-91fd-764ce76c57cb tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:16.630753 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-72f908e8-5158-4c8a-91fd-764ce76c57cb tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:16.631980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-72f908e8-5158-4c8a-91fd-764ce76c57cb tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:17.094501 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-72f908e8-5158-4c8a-91fd-764ce76c57cb tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "POST /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.498527 May 19 06:38:17.095725 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 367/736] 10.222.0.65 () {62 vars in 1363 bytes} [Thu May 19 06:38:16 2022] POST /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454/os-volume_attachments => generated 188 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 06:38:17.270164 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-747f572c-95e8-4a11-b50d-4d70332a7403 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:38:17.270737 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-747f572c-95e8-4a11-b50d-4d70332a7403 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:17.283396 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-747f572c-95e8-4a11-b50d-4d70332a7403 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:17.284882 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-747f572c-95e8-4a11-b50d-4d70332a7403 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:17.285830 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-747f572c-95e8-4a11-b50d-4d70332a7403 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:17.286290 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-747f572c-95e8-4a11-b50d-4d70332a7403 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:17.489720 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-747f572c-95e8-4a11-b50d-4d70332a7403 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "POST /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454/action" status: 202 len: 0 microversion: 2.20 time: 0.223391 May 19 06:38:17.490375 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 370/737] 10.222.0.65 () {62 vars in 1318 bytes} [Thu May 19 06:38:17 2022] POST /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 06:38:17.503181 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c8409dd8-0bd2-4978-aae8-dc1b6cc6145c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:17.504454 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c8409dd8-0bd2-4978-aae8-dc1b6cc6145c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:17.517408 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c8409dd8-0bd2-4978-aae8-dc1b6cc6145c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:17.518253 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c8409dd8-0bd2-4978-aae8-dc1b6cc6145c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:17.519524 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c8409dd8-0bd2-4978-aae8-dc1b6cc6145c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:17.520216 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c8409dd8-0bd2-4978-aae8-dc1b6cc6145c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:17.816814 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c8409dd8-0bd2-4978-aae8-dc1b6cc6145c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:17.842255 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c8409dd8-0bd2-4978-aae8-dc1b6cc6145c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:17.847243 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c8409dd8-0bd2-4978-aae8-dc1b6cc6145c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:17.850539 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c8409dd8-0bd2-4978-aae8-dc1b6cc6145c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1750 microversion: 2.20 time: 0.354772 May 19 06:38:17.855243 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 368/738] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:17 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1750 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 06:38:18.894417 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c84e73df-2e73-40ff-aa3f-b71d6b8a7a67 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:18.895784 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c84e73df-2e73-40ff-aa3f-b71d6b8a7a67 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:18.906717 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c84e73df-2e73-40ff-aa3f-b71d6b8a7a67 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:18.909678 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c84e73df-2e73-40ff-aa3f-b71d6b8a7a67 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:18.911127 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c84e73df-2e73-40ff-aa3f-b71d6b8a7a67 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:18.912103 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c84e73df-2e73-40ff-aa3f-b71d6b8a7a67 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:19.191178 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c84e73df-2e73-40ff-aa3f-b71d6b8a7a67 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:19.203727 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c84e73df-2e73-40ff-aa3f-b71d6b8a7a67 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:19.206422 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c84e73df-2e73-40ff-aa3f-b71d6b8a7a67 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:19.208862 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c84e73df-2e73-40ff-aa3f-b71d6b8a7a67 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1750 microversion: 2.20 time: 0.325497 May 19 06:38:19.210113 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 371/739] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:18 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1750 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:38:20.242799 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a3d27061-e14a-4791-a5c0-41447921d928 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:20.247323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a3d27061-e14a-4791-a5c0-41447921d928 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:20.284760 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a3d27061-e14a-4791-a5c0-41447921d928 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:20.286734 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a3d27061-e14a-4791-a5c0-41447921d928 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:20.288772 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a3d27061-e14a-4791-a5c0-41447921d928 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:20.289883 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a3d27061-e14a-4791-a5c0-41447921d928 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:20.695454 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a3d27061-e14a-4791-a5c0-41447921d928 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:20.711363 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a3d27061-e14a-4791-a5c0-41447921d928 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:20.721855 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a3d27061-e14a-4791-a5c0-41447921d928 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:20.734791 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a3d27061-e14a-4791-a5c0-41447921d928 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1752 microversion: 2.20 time: 0.501127 May 19 06:38:20.736505 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 369/740] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:20 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1752 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:38:21.768173 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ffb8e5ec-c488-4a1d-8242-24a9e03678da tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:21.772972 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ffb8e5ec-c488-4a1d-8242-24a9e03678da tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:21.785589 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ffb8e5ec-c488-4a1d-8242-24a9e03678da tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:21.787005 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ffb8e5ec-c488-4a1d-8242-24a9e03678da tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:21.788483 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ffb8e5ec-c488-4a1d-8242-24a9e03678da tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:21.789212 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ffb8e5ec-c488-4a1d-8242-24a9e03678da tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:22.231111 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ffb8e5ec-c488-4a1d-8242-24a9e03678da tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:22.252362 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ffb8e5ec-c488-4a1d-8242-24a9e03678da tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:22.255933 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ffb8e5ec-c488-4a1d-8242-24a9e03678da tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:22.257629 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ffb8e5ec-c488-4a1d-8242-24a9e03678da tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1808 microversion: 2.20 time: 0.497456 May 19 06:38:22.258440 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 372/741] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:21 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1808 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:38:23.277329 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e4d876f1-686e-4f1e-92fe-ab3317ac60a5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:23.278223 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e4d876f1-686e-4f1e-92fe-ab3317ac60a5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:23.303591 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e4d876f1-686e-4f1e-92fe-ab3317ac60a5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:23.304207 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e4d876f1-686e-4f1e-92fe-ab3317ac60a5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:23.305176 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e4d876f1-686e-4f1e-92fe-ab3317ac60a5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:23.306080 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e4d876f1-686e-4f1e-92fe-ab3317ac60a5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:24.081811 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e4d876f1-686e-4f1e-92fe-ab3317ac60a5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:24.098364 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e4d876f1-686e-4f1e-92fe-ab3317ac60a5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:24.101070 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e4d876f1-686e-4f1e-92fe-ab3317ac60a5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:24.102713 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e4d876f1-686e-4f1e-92fe-ab3317ac60a5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1808 microversion: 2.20 time: 0.830658 May 19 06:38:24.107526 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 370/742] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:23 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1808 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:38:25.094109 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-575463c8-1681-47f4-9d58-9dad29ed6081 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-499613555", "imageRef": "27959167-098e-44c5-ba0a-e9fb8054c377", "flavorRef": "452", "networks": [{"uuid": "87d6fb60-2cd1-43b1-8e28-e6a214bcc197"}]}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:38:25.126399 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b434f3e0-6fea-48eb-92b1-53cd6162aebc tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:25.127036 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b434f3e0-6fea-48eb-92b1-53cd6162aebc tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:25.159563 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b434f3e0-6fea-48eb-92b1-53cd6162aebc tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:25.159944 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b434f3e0-6fea-48eb-92b1-53cd6162aebc tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:25.160607 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b434f3e0-6fea-48eb-92b1-53cd6162aebc tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:25.160992 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b434f3e0-6fea-48eb-92b1-53cd6162aebc tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:25.262561 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.network.neutron [None req-575463c8-1681-47f4-9d58-9dad29ed6081 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] validate_networks() for [('87d6fb60-2cd1-43b1-8e28-e6a214bcc197', None, None, None, None, None)] {{(pid=117711) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 06:38:25.708094 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b434f3e0-6fea-48eb-92b1-53cd6162aebc tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:25.732538 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b434f3e0-6fea-48eb-92b1-53cd6162aebc tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:25.763207 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b434f3e0-6fea-48eb-92b1-53cd6162aebc tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:25.768451 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b434f3e0-6fea-48eb-92b1-53cd6162aebc tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1808 microversion: 2.20 time: 0.646278 May 19 06:38:25.788421 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 371/743] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:25 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1808 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:38:26.317057 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-575463c8-1681-47f4-9d58-9dad29ed6081 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Flavor limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 06:38:26.321221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-575463c8-1681-47f4-9d58-9dad29ed6081 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Image limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 06:38:26.322470 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-575463c8-1681-47f4-9d58-9dad29ed6081 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Flavor pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 06:38:26.334544 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-575463c8-1681-47f4-9d58-9dad29ed6081 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Image pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 06:38:26.335809 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-575463c8-1681-47f4-9d58-9dad29ed6081 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 06:38:26.376967 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-575463c8-1681-47f4-9d58-9dad29ed6081 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:26.377748 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-575463c8-1681-47f4-9d58-9dad29ed6081 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:26.382271 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-575463c8-1681-47f4-9d58-9dad29ed6081 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:26.383091 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-575463c8-1681-47f4-9d58-9dad29ed6081 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:26.426509 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-575463c8-1681-47f4-9d58-9dad29ed6081 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Getting quotas for project 887496db011b48b5a8a5f2da6d8c5e44. Resources: {'ram', 'cores', 'instances'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:38:26.432378 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-575463c8-1681-47f4-9d58-9dad29ed6081 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Getting quotas for user 87cde6f1714941f9a0a094332eae9404 and project 887496db011b48b5a8a5f2da6d8c5e44. Resources: {'ram', 'cores', 'instances'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:38:26.450082 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-575463c8-1681-47f4-9d58-9dad29ed6081 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Going to run 1 instances... {{(pid=117711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 06:38:26.452779 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-575463c8-1681-47f4-9d58-9dad29ed6081 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 9b11d98c-676f-43a9-8d2b-f052a0d614be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27959167-098e-44c5-ba0a-e9fb8054c377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 06:38:26.526500 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-575463c8-1681-47f4-9d58-9dad29ed6081 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.437878 May 19 06:38:26.528825 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 373/744] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 06:38:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 06:38:26.544929 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d2338ee2-d886-421f-8ae9-52940470b290 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:26.546247 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d2338ee2-d886-421f-8ae9-52940470b290 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 9b11d98c-676f-43a9-8d2b-f052a0d614be] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:26.807512 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b5776c84-be13-4f1a-a8f6-f9813e4269a1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:26.808139 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b5776c84-be13-4f1a-a8f6-f9813e4269a1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:26.821749 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b5776c84-be13-4f1a-a8f6-f9813e4269a1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:26.822566 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b5776c84-be13-4f1a-a8f6-f9813e4269a1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:26.823670 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b5776c84-be13-4f1a-a8f6-f9813e4269a1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:26.824136 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b5776c84-be13-4f1a-a8f6-f9813e4269a1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:26.839302 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d2338ee2-d886-421f-8ae9-52940470b290 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cde6f1714941f9a0a094332eae9404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887496db011b48b5a8a5f2da6d8c5e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:26.851035 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d2338ee2-d886-421f-8ae9-52940470b290 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be" status: 200 len: 1218 microversion: 2.1 time: 0.314853 May 19 06:38:26.870874 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 372/745] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:38:26 2022] GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be => generated 1218 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:38:27.171561 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b5776c84-be13-4f1a-a8f6-f9813e4269a1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:27.181678 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b5776c84-be13-4f1a-a8f6-f9813e4269a1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:27.200616 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b5776c84-be13-4f1a-a8f6-f9813e4269a1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:27.201893 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b5776c84-be13-4f1a-a8f6-f9813e4269a1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1808 microversion: 2.20 time: 0.398822 May 19 06:38:27.202451 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 374/746] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:26 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1808 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:38:27.874012 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-10c10e6e-872e-4375-9bab-6ad0ebe7fb27 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:27.874730 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-10c10e6e-872e-4375-9bab-6ad0ebe7fb27 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 9b11d98c-676f-43a9-8d2b-f052a0d614be] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:27.885061 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-10c10e6e-872e-4375-9bab-6ad0ebe7fb27 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:27.896589 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-10c10e6e-872e-4375-9bab-6ad0ebe7fb27 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:27.897570 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-10c10e6e-872e-4375-9bab-6ad0ebe7fb27 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:27.898122 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-10c10e6e-872e-4375-9bab-6ad0ebe7fb27 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:27.995810 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-100d8314-6133-47d6-b61a-fd96fef47a66 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Action: 'create', calling method: .version_select at 0x7f9aeab08940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1671934445", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrTVHlszFNUxibIfKxqagm/7fgLZ7wItGnpO1yn9yMw8/5U7jWRdGLhECFe9ottAgYV7BhzYqUS+PiXOeyqoufJvnZwpLy010rV5AtunU/41ZLv0WXJdKC6jGANr8Gr8A=="}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:38:28.031720 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-10c10e6e-872e-4375-9bab-6ad0ebe7fb27 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cde6f1714941f9a0a094332eae9404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887496db011b48b5a8a5f2da6d8c5e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:28.040001 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-10c10e6e-872e-4375-9bab-6ad0ebe7fb27 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be" status: 200 len: 1222 microversion: 2.1 time: 0.170094 May 19 06:38:28.040675 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-100d8314-6133-47d6-b61a-fd96fef47a66 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Getting quotas for project 318e4e0d9f3a49f69eb3d846539b6b67. Resources: {'key_pairs'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:38:28.042118 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 375/747] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:38:27 2022] GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be => generated 1222 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:38:28.058184 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-100d8314-6133-47d6-b61a-fd96fef47a66 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Getting quotas for user c1815cc5a2fd43259c5b53650dbc7603 and project 318e4e0d9f3a49f69eb3d846539b6b67. Resources: {'key_pairs'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:38:28.090660 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-100d8314-6133-47d6-b61a-fd96fef47a66 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.486866 May 19 06:38:28.091767 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 373/748] 10.222.0.65 () {60 vars in 1158 bytes} [Thu May 19 06:38:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:38:28.220498 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7c0a18cf-a868-451f-8090-a4c29f22c8ff tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:28.221306 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7c0a18cf-a868-451f-8090-a4c29f22c8ff tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:28.240334 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7c0a18cf-a868-451f-8090-a4c29f22c8ff tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:28.241319 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7c0a18cf-a868-451f-8090-a4c29f22c8ff tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:28.242149 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7c0a18cf-a868-451f-8090-a4c29f22c8ff tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:28.242586 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7c0a18cf-a868-451f-8090-a4c29f22c8ff tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:28.480748 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7c0a18cf-a868-451f-8090-a4c29f22c8ff tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:28.494222 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7c0a18cf-a868-451f-8090-a4c29f22c8ff tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:28.496181 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7c0a18cf-a868-451f-8090-a4c29f22c8ff tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:28.497532 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7c0a18cf-a868-451f-8090-a4c29f22c8ff tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1808 microversion: 2.20 time: 0.280915 May 19 06:38:28.508388 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 376/749] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:28 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1808 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:38:29.058735 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f59ca604-d32d-435d-b25f-896aed51d05d tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:29.059362 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f59ca604-d32d-435d-b25f-896aed51d05d tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 9b11d98c-676f-43a9-8d2b-f052a0d614be] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:29.072092 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f59ca604-d32d-435d-b25f-896aed51d05d tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:29.072596 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f59ca604-d32d-435d-b25f-896aed51d05d tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:29.073734 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f59ca604-d32d-435d-b25f-896aed51d05d tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:29.074181 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f59ca604-d32d-435d-b25f-896aed51d05d tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:29.211029 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f59ca604-d32d-435d-b25f-896aed51d05d tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cde6f1714941f9a0a094332eae9404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887496db011b48b5a8a5f2da6d8c5e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:29.222622 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f59ca604-d32d-435d-b25f-896aed51d05d tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be" status: 200 len: 1222 microversion: 2.1 time: 0.168508 May 19 06:38:29.225953 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 374/750] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:38:29 2022] GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be => generated 1222 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:38:29.519411 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0150fe84-b66e-4481-921f-aa2659c755c3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:29.523142 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0150fe84-b66e-4481-921f-aa2659c755c3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:29.535630 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0150fe84-b66e-4481-921f-aa2659c755c3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:29.536331 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0150fe84-b66e-4481-921f-aa2659c755c3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:29.537449 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0150fe84-b66e-4481-921f-aa2659c755c3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:29.545770 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0150fe84-b66e-4481-921f-aa2659c755c3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:29.799398 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0150fe84-b66e-4481-921f-aa2659c755c3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:29.840893 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0150fe84-b66e-4481-921f-aa2659c755c3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:29.846918 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0150fe84-b66e-4481-921f-aa2659c755c3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:29.856716 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0150fe84-b66e-4481-921f-aa2659c755c3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1808 microversion: 2.20 time: 0.342405 May 19 06:38:29.859111 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 377/751] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:29 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1808 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:38:30.242592 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-822977a8-ac1e-43b2-ad4e-9e7e26ccb08c tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:30.244021 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-822977a8-ac1e-43b2-ad4e-9e7e26ccb08c tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 9b11d98c-676f-43a9-8d2b-f052a0d614be] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:30.256495 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-822977a8-ac1e-43b2-ad4e-9e7e26ccb08c tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:30.259879 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-822977a8-ac1e-43b2-ad4e-9e7e26ccb08c tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:30.263362 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-822977a8-ac1e-43b2-ad4e-9e7e26ccb08c tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:30.264361 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-822977a8-ac1e-43b2-ad4e-9e7e26ccb08c tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:30.433309 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-822977a8-ac1e-43b2-ad4e-9e7e26ccb08c tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cde6f1714941f9a0a094332eae9404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887496db011b48b5a8a5f2da6d8c5e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:30.443061 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-822977a8-ac1e-43b2-ad4e-9e7e26ccb08c tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be" status: 200 len: 1222 microversion: 2.1 time: 0.204824 May 19 06:38:30.444843 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 375/752] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:38:30 2022] GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be => generated 1222 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:38:30.878152 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-fb82f20c-c197-4892-82ea-21d38c58ee9b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:30.879743 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-fb82f20c-c197-4892-82ea-21d38c58ee9b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:30.906823 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fb82f20c-c197-4892-82ea-21d38c58ee9b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:30.907889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fb82f20c-c197-4892-82ea-21d38c58ee9b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:30.922405 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fb82f20c-c197-4892-82ea-21d38c58ee9b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:30.923273 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fb82f20c-c197-4892-82ea-21d38c58ee9b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:31.247649 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-fb82f20c-c197-4892-82ea-21d38c58ee9b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:31.274866 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-fb82f20c-c197-4892-82ea-21d38c58ee9b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:31.276787 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-fb82f20c-c197-4892-82ea-21d38c58ee9b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:31.285014 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-fb82f20c-c197-4892-82ea-21d38c58ee9b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1808 microversion: 2.20 time: 0.404374 May 19 06:38:31.286593 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 378/753] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:30 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1808 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:38:31.467749 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-488588ca-29c5-456f-82b9-b567296cc264 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:31.468365 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-488588ca-29c5-456f-82b9-b567296cc264 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 9b11d98c-676f-43a9-8d2b-f052a0d614be] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:31.499313 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-488588ca-29c5-456f-82b9-b567296cc264 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:31.500350 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-488588ca-29c5-456f-82b9-b567296cc264 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:31.502092 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-488588ca-29c5-456f-82b9-b567296cc264 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:31.502812 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-488588ca-29c5-456f-82b9-b567296cc264 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:31.580737 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-488588ca-29c5-456f-82b9-b567296cc264 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cde6f1714941f9a0a094332eae9404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887496db011b48b5a8a5f2da6d8c5e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:31.590505 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-488588ca-29c5-456f-82b9-b567296cc264 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be" status: 200 len: 1222 microversion: 2.1 time: 0.131056 May 19 06:38:31.591699 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 376/754] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:38:31 2022] GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be => generated 1222 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:38:32.329981 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b241c4a0-1f03-49e1-bece-f9acd8323fb5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:32.340866 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b241c4a0-1f03-49e1-bece-f9acd8323fb5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:32.352704 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b241c4a0-1f03-49e1-bece-f9acd8323fb5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:32.353545 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b241c4a0-1f03-49e1-bece-f9acd8323fb5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:32.355437 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b241c4a0-1f03-49e1-bece-f9acd8323fb5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:32.355883 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b241c4a0-1f03-49e1-bece-f9acd8323fb5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:32.609561 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-706ea724-23ce-43e5-900c-f2d32cc2191b tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:32.610951 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-706ea724-23ce-43e5-900c-f2d32cc2191b tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 9b11d98c-676f-43a9-8d2b-f052a0d614be] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:32.633447 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-706ea724-23ce-43e5-900c-f2d32cc2191b tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:32.638146 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-706ea724-23ce-43e5-900c-f2d32cc2191b tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:32.639315 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-706ea724-23ce-43e5-900c-f2d32cc2191b tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:32.640244 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-706ea724-23ce-43e5-900c-f2d32cc2191b tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:32.653425 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b241c4a0-1f03-49e1-bece-f9acd8323fb5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:32.670860 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b241c4a0-1f03-49e1-bece-f9acd8323fb5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:32.673724 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b241c4a0-1f03-49e1-bece-f9acd8323fb5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:32.675048 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b241c4a0-1f03-49e1-bece-f9acd8323fb5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1808 microversion: 2.20 time: 0.362150 May 19 06:38:32.675678 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 379/755] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:32 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1808 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:38:32.747772 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-706ea724-23ce-43e5-900c-f2d32cc2191b tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cde6f1714941f9a0a094332eae9404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887496db011b48b5a8a5f2da6d8c5e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:32.756166 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-706ea724-23ce-43e5-900c-f2d32cc2191b tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be" status: 200 len: 1222 microversion: 2.1 time: 0.151765 May 19 06:38:32.756758 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 377/756] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:38:32 2022] GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be => generated 1222 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:38:33.695201 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-fd577458-6d05-4593-9308-d45ff845e4ea tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:33.696024 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-fd577458-6d05-4593-9308-d45ff845e4ea tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:33.704295 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fd577458-6d05-4593-9308-d45ff845e4ea tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:33.704748 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fd577458-6d05-4593-9308-d45ff845e4ea tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:33.705623 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fd577458-6d05-4593-9308-d45ff845e4ea tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:33.706255 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fd577458-6d05-4593-9308-d45ff845e4ea tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:33.777054 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1a2a6f40-b0a2-4ddd-b5da-e8ae7946821f tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:33.778882 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1a2a6f40-b0a2-4ddd-b5da-e8ae7946821f tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 9b11d98c-676f-43a9-8d2b-f052a0d614be] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:33.787121 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1a2a6f40-b0a2-4ddd-b5da-e8ae7946821f tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:33.787574 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1a2a6f40-b0a2-4ddd-b5da-e8ae7946821f tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:33.788370 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1a2a6f40-b0a2-4ddd-b5da-e8ae7946821f tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:33.788799 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1a2a6f40-b0a2-4ddd-b5da-e8ae7946821f tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:33.857861 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1a2a6f40-b0a2-4ddd-b5da-e8ae7946821f tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cde6f1714941f9a0a094332eae9404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887496db011b48b5a8a5f2da6d8c5e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:33.865009 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-fd577458-6d05-4593-9308-d45ff845e4ea tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:33.866419 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1a2a6f40-b0a2-4ddd-b5da-e8ae7946821f tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be" status: 200 len: 1222 microversion: 2.1 time: 0.093940 May 19 06:38:33.866419 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 378/757] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:38:33 2022] GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:38:33.874787 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-fd577458-6d05-4593-9308-d45ff845e4ea tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:33.876377 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-fd577458-6d05-4593-9308-d45ff845e4ea tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:33.877557 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-fd577458-6d05-4593-9308-d45ff845e4ea tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1808 microversion: 2.20 time: 0.187227 May 19 06:38:33.878120 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 380/758] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:33 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:38:34.883387 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0150dfe6-024f-4475-be2a-a9f813029b1a tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:34.884023 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0150dfe6-024f-4475-be2a-a9f813029b1a tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 9b11d98c-676f-43a9-8d2b-f052a0d614be] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:34.893020 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0150dfe6-024f-4475-be2a-a9f813029b1a tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:34.893424 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0150dfe6-024f-4475-be2a-a9f813029b1a tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:34.894201 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0150dfe6-024f-4475-be2a-a9f813029b1a tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:34.894630 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0150dfe6-024f-4475-be2a-a9f813029b1a tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:34.897309 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-df1ad547-8c2c-425b-83f0-b08009c0fef3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:34.898241 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-df1ad547-8c2c-425b-83f0-b08009c0fef3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:34.898431 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:38:34.905392 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-df1ad547-8c2c-425b-83f0-b08009c0fef3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:34.905853 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-df1ad547-8c2c-425b-83f0-b08009c0fef3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:34.906696 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-df1ad547-8c2c-425b-83f0-b08009c0fef3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:34.907128 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-df1ad547-8c2c-425b-83f0-b08009c0fef3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:35.002412 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0150dfe6-024f-4475-be2a-a9f813029b1a tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cde6f1714941f9a0a094332eae9404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887496db011b48b5a8a5f2da6d8c5e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:35.015403 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0150dfe6-024f-4475-be2a-a9f813029b1a tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be" status: 200 len: 1270 microversion: 2.1 time: 0.135315 May 19 06:38:35.016059 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 379/759] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:38:34 2022] GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be => generated 1270 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:38:35.175796 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-df1ad547-8c2c-425b-83f0-b08009c0fef3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:35.184841 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-df1ad547-8c2c-425b-83f0-b08009c0fef3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:35.187891 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-df1ad547-8c2c-425b-83f0-b08009c0fef3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:35.189273 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-df1ad547-8c2c-425b-83f0-b08009c0fef3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1808 microversion: 2.20 time: 0.296490 May 19 06:38:35.190198 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 381/760] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:34 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1808 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:38:36.034063 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-83bc2b26-c3e5-44e4-a0f2-6c9b18f5b69f tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:36.035000 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-83bc2b26-c3e5-44e4-a0f2-6c9b18f5b69f tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 9b11d98c-676f-43a9-8d2b-f052a0d614be] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:36.043504 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-83bc2b26-c3e5-44e4-a0f2-6c9b18f5b69f tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:36.044071 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-83bc2b26-c3e5-44e4-a0f2-6c9b18f5b69f tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:36.044878 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-83bc2b26-c3e5-44e4-a0f2-6c9b18f5b69f tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:36.045343 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-83bc2b26-c3e5-44e4-a0f2-6c9b18f5b69f tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:36.209766 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-42bdfcb4-5be3-4ed0-9296-1f33215f4125 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:36.210374 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-42bdfcb4-5be3-4ed0-9296-1f33215f4125 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:36.217207 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-42bdfcb4-5be3-4ed0-9296-1f33215f4125 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:36.217724 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-42bdfcb4-5be3-4ed0-9296-1f33215f4125 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:36.218499 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-42bdfcb4-5be3-4ed0-9296-1f33215f4125 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:36.218938 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-42bdfcb4-5be3-4ed0-9296-1f33215f4125 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:36.223506 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:38:36.368059 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-83bc2b26-c3e5-44e4-a0f2-6c9b18f5b69f tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cde6f1714941f9a0a094332eae9404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887496db011b48b5a8a5f2da6d8c5e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:36.377391 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-83bc2b26-c3e5-44e4-a0f2-6c9b18f5b69f tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be" status: 200 len: 1318 microversion: 2.1 time: 0.347562 May 19 06:38:36.377976 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 380/761] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:38:36 2022] GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:38:36.398155 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:38:36.443020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=6 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:38:36.454186 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-42bdfcb4-5be3-4ed0-9296-1f33215f4125 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:36.462676 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-42bdfcb4-5be3-4ed0-9296-1f33215f4125 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:36.464838 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-42bdfcb4-5be3-4ed0-9296-1f33215f4125 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:36.466211 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-42bdfcb4-5be3-4ed0-9296-1f33215f4125 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1808 microversion: 2.20 time: 0.260346 May 19 06:38:36.466978 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 382/762] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:36 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1808 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 06:38:36.615737 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-a30fc807-b195-488f-b58a-8dfad8cbb6a6 req-2c3fac14-3985-452f-ac6c-98dc7f0e3fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b11d98c-676f-43a9-8d2b-f052a0d614be", "tag": "e403aee9-b9e1-4257-a333-441e2cafc81b"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:38:36.625341 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-a30fc807-b195-488f-b58a-8dfad8cbb6a6 req-2c3fac14-3985-452f-ac6c-98dc7f0e3fe7 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:36.626106 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-a30fc807-b195-488f-b58a-8dfad8cbb6a6 req-2c3fac14-3985-452f-ac6c-98dc7f0e3fe7 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:36.640925 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-a30fc807-b195-488f-b58a-8dfad8cbb6a6 req-2c3fac14-3985-452f-ac6c-98dc7f0e3fe7 service nova] Creating event network-changed:e403aee9-b9e1-4257-a333-441e2cafc81b for instance 9b11d98c-676f-43a9-8d2b-f052a0d614be on hv-cinder-83699 May 19 06:38:36.646035 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-a30fc807-b195-488f-b58a-8dfad8cbb6a6 req-2c3fac14-3985-452f-ac6c-98dc7f0e3fe7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035145 May 19 06:38:36.646699 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 381/763] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:38:37.394947 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-25905824-25c6-4630-917b-6635ed148130 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:37.395612 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-25905824-25c6-4630-917b-6635ed148130 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 9b11d98c-676f-43a9-8d2b-f052a0d614be] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:37.397964 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:38:37.404005 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-25905824-25c6-4630-917b-6635ed148130 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:37.404458 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-25905824-25c6-4630-917b-6635ed148130 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:37.405229 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-25905824-25c6-4630-917b-6635ed148130 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:37.405688 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-25905824-25c6-4630-917b-6635ed148130 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:37.487479 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-83ede030-a72e-4b6f-aad3-6609fab76696 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:37.488230 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-83ede030-a72e-4b6f-aad3-6609fab76696 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:37.495871 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-83ede030-a72e-4b6f-aad3-6609fab76696 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:37.496320 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-83ede030-a72e-4b6f-aad3-6609fab76696 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:37.497096 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-83ede030-a72e-4b6f-aad3-6609fab76696 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:37.497552 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-83ede030-a72e-4b6f-aad3-6609fab76696 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:37.582927 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-25905824-25c6-4630-917b-6635ed148130 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cde6f1714941f9a0a094332eae9404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887496db011b48b5a8a5f2da6d8c5e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:37.593112 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-25905824-25c6-4630-917b-6635ed148130 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be" status: 200 len: 1318 microversion: 2.1 time: 0.201758 May 19 06:38:37.593665 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 383/764] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:38:37 2022] GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:38:37.650331 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-83ede030-a72e-4b6f-aad3-6609fab76696 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:37.661085 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-83ede030-a72e-4b6f-aad3-6609fab76696 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:37.663022 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-83ede030-a72e-4b6f-aad3-6609fab76696 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:37.664601 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-83ede030-a72e-4b6f-aad3-6609fab76696 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1808 microversion: 2.20 time: 0.182597 May 19 06:38:37.665468 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 382/765] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:37 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 06:38:38.611290 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-de05883f-7142-4dd3-80fc-4b9a6ae9ad62 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:38.611937 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-de05883f-7142-4dd3-80fc-4b9a6ae9ad62 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 9b11d98c-676f-43a9-8d2b-f052a0d614be] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:38.618796 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-de05883f-7142-4dd3-80fc-4b9a6ae9ad62 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:38.619243 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-de05883f-7142-4dd3-80fc-4b9a6ae9ad62 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:38.620052 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-de05883f-7142-4dd3-80fc-4b9a6ae9ad62 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:38.620486 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-de05883f-7142-4dd3-80fc-4b9a6ae9ad62 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:38.694406 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1abf54ef-8ea9-4192-ad72-72febf58941a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:38.695537 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1abf54ef-8ea9-4192-ad72-72febf58941a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:38.699020 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=6 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:38:38.700821 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:38:38.711780 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1abf54ef-8ea9-4192-ad72-72febf58941a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:38.712387 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1abf54ef-8ea9-4192-ad72-72febf58941a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:38.714162 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1abf54ef-8ea9-4192-ad72-72febf58941a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:38.714874 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1abf54ef-8ea9-4192-ad72-72febf58941a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:38.800702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-de05883f-7142-4dd3-80fc-4b9a6ae9ad62 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cde6f1714941f9a0a094332eae9404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887496db011b48b5a8a5f2da6d8c5e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:38.824894 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-de05883f-7142-4dd3-80fc-4b9a6ae9ad62 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be" status: 200 len: 1318 microversion: 2.1 time: 0.217206 May 19 06:38:38.825972 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 384/766] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:38:38 2022] GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:38:38.907467 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1abf54ef-8ea9-4192-ad72-72febf58941a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:38.916623 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1abf54ef-8ea9-4192-ad72-72febf58941a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:38.918141 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1abf54ef-8ea9-4192-ad72-72febf58941a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:38.919457 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1abf54ef-8ea9-4192-ad72-72febf58941a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1808 microversion: 2.20 time: 0.232150 May 19 06:38:38.920255 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 383/767] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:38 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 06:38:39.842509 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6be3b973-d5c4-4f61-8d1c-93afe3f36394 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:39.843369 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6be3b973-d5c4-4f61-8d1c-93afe3f36394 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 9b11d98c-676f-43a9-8d2b-f052a0d614be] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:39.849792 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6be3b973-d5c4-4f61-8d1c-93afe3f36394 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:39.850232 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6be3b973-d5c4-4f61-8d1c-93afe3f36394 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:39.850995 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6be3b973-d5c4-4f61-8d1c-93afe3f36394 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:39.851432 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6be3b973-d5c4-4f61-8d1c-93afe3f36394 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:39.941087 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ddc44055-1665-4820-abe9-f33fb6ac5e2b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:39.941716 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ddc44055-1665-4820-abe9-f33fb6ac5e2b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:39.949274 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ddc44055-1665-4820-abe9-f33fb6ac5e2b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:39.949835 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ddc44055-1665-4820-abe9-f33fb6ac5e2b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:39.950686 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ddc44055-1665-4820-abe9-f33fb6ac5e2b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:39.951196 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ddc44055-1665-4820-abe9-f33fb6ac5e2b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:39.993792 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6be3b973-d5c4-4f61-8d1c-93afe3f36394 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cde6f1714941f9a0a094332eae9404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887496db011b48b5a8a5f2da6d8c5e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:40.001549 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6be3b973-d5c4-4f61-8d1c-93afe3f36394 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be" status: 200 len: 1318 microversion: 2.1 time: 0.163283 May 19 06:38:40.002156 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 385/768] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:38:39 2022] GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:38:40.086255 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ddc44055-1665-4820-abe9-f33fb6ac5e2b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:40.096022 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ddc44055-1665-4820-abe9-f33fb6ac5e2b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:40.097832 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ddc44055-1665-4820-abe9-f33fb6ac5e2b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:40.099328 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ddc44055-1665-4820-abe9-f33fb6ac5e2b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1808 microversion: 2.20 time: 0.162635 May 19 06:38:40.099943 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 384/769] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:39 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 06:38:41.018672 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d1f00c07-d5d6-4e4c-a096-3c0f5b527aaa tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:41.019279 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d1f00c07-d5d6-4e4c-a096-3c0f5b527aaa tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 9b11d98c-676f-43a9-8d2b-f052a0d614be] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:41.025844 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d1f00c07-d5d6-4e4c-a096-3c0f5b527aaa tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:41.026777 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d1f00c07-d5d6-4e4c-a096-3c0f5b527aaa tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:41.027540 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d1f00c07-d5d6-4e4c-a096-3c0f5b527aaa tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:41.027967 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d1f00c07-d5d6-4e4c-a096-3c0f5b527aaa tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:41.034984 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-53d181d4-63a4-4ae8-8224-c8ab4934ceaa req-d5de64a1-cefa-4b71-be8a-29b1e9824207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b11d98c-676f-43a9-8d2b-f052a0d614be", "name": "network-vif-plugged", "status": "completed", "tag": "e403aee9-b9e1-4257-a333-441e2cafc81b"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:38:41.045106 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-53d181d4-63a4-4ae8-8224-c8ab4934ceaa req-d5de64a1-cefa-4b71-be8a-29b1e9824207 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:41.046138 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-53d181d4-63a4-4ae8-8224-c8ab4934ceaa req-d5de64a1-cefa-4b71-be8a-29b1e9824207 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:41.058989 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-53d181d4-63a4-4ae8-8224-c8ab4934ceaa req-d5de64a1-cefa-4b71-be8a-29b1e9824207 service nova] Creating event network-vif-plugged:e403aee9-b9e1-4257-a333-441e2cafc81b for instance 9b11d98c-676f-43a9-8d2b-f052a0d614be on hv-cinder-83699 May 19 06:38:41.063745 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-53d181d4-63a4-4ae8-8224-c8ab4934ceaa req-d5de64a1-cefa-4b71-be8a-29b1e9824207 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032440 May 19 06:38:41.064350 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 385/770] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:38:41.120082 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-30e886bc-df6e-4962-a93e-577a3fe400bc tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:41.121088 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-30e886bc-df6e-4962-a93e-577a3fe400bc tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:41.146130 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-30e886bc-df6e-4962-a93e-577a3fe400bc tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:41.146602 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-30e886bc-df6e-4962-a93e-577a3fe400bc tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:41.147614 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-30e886bc-df6e-4962-a93e-577a3fe400bc tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:41.149574 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-30e886bc-df6e-4962-a93e-577a3fe400bc tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:41.266191 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d1f00c07-d5d6-4e4c-a096-3c0f5b527aaa tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cde6f1714941f9a0a094332eae9404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887496db011b48b5a8a5f2da6d8c5e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:41.273936 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d1f00c07-d5d6-4e4c-a096-3c0f5b527aaa tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be" status: 200 len: 1318 microversion: 2.1 time: 0.259035 May 19 06:38:41.274788 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 386/771] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:38:41 2022] GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:38:41.325461 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-30e886bc-df6e-4962-a93e-577a3fe400bc tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:41.340836 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-30e886bc-df6e-4962-a93e-577a3fe400bc tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:41.346973 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-30e886bc-df6e-4962-a93e-577a3fe400bc tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:41.348232 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-30e886bc-df6e-4962-a93e-577a3fe400bc tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1808 microversion: 2.20 time: 0.234267 May 19 06:38:41.360211 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 386/772] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:41 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1808 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 06:38:42.291905 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a084dada-7af9-4322-8823-f058d6eeba86 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:42.292841 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a084dada-7af9-4322-8823-f058d6eeba86 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 9b11d98c-676f-43a9-8d2b-f052a0d614be] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:42.299594 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a084dada-7af9-4322-8823-f058d6eeba86 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:42.300042 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a084dada-7af9-4322-8823-f058d6eeba86 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:42.300797 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a084dada-7af9-4322-8823-f058d6eeba86 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:42.301226 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a084dada-7af9-4322-8823-f058d6eeba86 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:42.367906 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-299493af-2b16-47e0-8589-d6282626a469 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:42.368571 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-299493af-2b16-47e0-8589-d6282626a469 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:42.375831 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-299493af-2b16-47e0-8589-d6282626a469 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:42.376284 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-299493af-2b16-47e0-8589-d6282626a469 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:42.377043 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-299493af-2b16-47e0-8589-d6282626a469 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:42.377501 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-299493af-2b16-47e0-8589-d6282626a469 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:42.435536 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a084dada-7af9-4322-8823-f058d6eeba86 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cde6f1714941f9a0a094332eae9404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887496db011b48b5a8a5f2da6d8c5e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:42.443090 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a084dada-7af9-4322-8823-f058d6eeba86 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be" status: 200 len: 1318 microversion: 2.1 time: 0.155025 May 19 06:38:42.443860 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 387/773] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:38:42 2022] GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:38:42.512634 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-299493af-2b16-47e0-8589-d6282626a469 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:42.521104 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-299493af-2b16-47e0-8589-d6282626a469 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:42.522634 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-299493af-2b16-47e0-8589-d6282626a469 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:42.523780 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-299493af-2b16-47e0-8589-d6282626a469 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1808 microversion: 2.20 time: 0.159891 May 19 06:38:42.524335 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 387/774] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:42 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 06:38:43.094971 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-4d4dfccf-8adb-441d-a87e-245f9bc8a716 req-1dd7a2df-9a51-4694-908e-48e0b56449b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06323e6f-7b35-407f-aecf-5435fa013454", "name": "network-vif-plugged", "status": "completed", "tag": "b967f972-267a-488a-a383-8186a8a77201"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:38:43.105026 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-4d4dfccf-8adb-441d-a87e-245f9bc8a716 req-1dd7a2df-9a51-4694-908e-48e0b56449b6 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:43.105676 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-4d4dfccf-8adb-441d-a87e-245f9bc8a716 req-1dd7a2df-9a51-4694-908e-48e0b56449b6 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:43.117893 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-4d4dfccf-8adb-441d-a87e-245f9bc8a716 req-1dd7a2df-9a51-4694-908e-48e0b56449b6 service nova] Creating event network-vif-plugged:b967f972-267a-488a-a383-8186a8a77201 for instance 06323e6f-7b35-407f-aecf-5435fa013454 on hv-cinder-83699 May 19 06:38:43.123472 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-4d4dfccf-8adb-441d-a87e-245f9bc8a716 req-1dd7a2df-9a51-4694-908e-48e0b56449b6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032623 May 19 06:38:43.124074 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 388/775] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:38:43.462709 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1cf09c04-3deb-42cb-be59-b8ac53813d20 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:43.462709 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1cf09c04-3deb-42cb-be59-b8ac53813d20 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 9b11d98c-676f-43a9-8d2b-f052a0d614be] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:43.469491 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1cf09c04-3deb-42cb-be59-b8ac53813d20 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:43.469941 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1cf09c04-3deb-42cb-be59-b8ac53813d20 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:43.470710 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1cf09c04-3deb-42cb-be59-b8ac53813d20 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:43.471151 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1cf09c04-3deb-42cb-be59-b8ac53813d20 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:43.543308 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-bba0ff35-b0b3-43b9-beb3-8a7bf05b9cf1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:43.544128 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-bba0ff35-b0b3-43b9-beb3-8a7bf05b9cf1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:43.552374 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bba0ff35-b0b3-43b9-beb3-8a7bf05b9cf1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:43.552910 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bba0ff35-b0b3-43b9-beb3-8a7bf05b9cf1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:43.553742 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bba0ff35-b0b3-43b9-beb3-8a7bf05b9cf1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:43.554176 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bba0ff35-b0b3-43b9-beb3-8a7bf05b9cf1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:43.620351 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1cf09c04-3deb-42cb-be59-b8ac53813d20 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cde6f1714941f9a0a094332eae9404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887496db011b48b5a8a5f2da6d8c5e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:43.630725 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1cf09c04-3deb-42cb-be59-b8ac53813d20 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be" status: 200 len: 1507 microversion: 2.1 time: 0.173714 May 19 06:38:43.631590 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 388/776] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:38:43 2022] GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:38:43.734537 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-bba0ff35-b0b3-43b9-beb3-8a7bf05b9cf1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:43.743864 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-bba0ff35-b0b3-43b9-beb3-8a7bf05b9cf1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:43.746396 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-bba0ff35-b0b3-43b9-beb3-8a7bf05b9cf1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:43.747912 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-bba0ff35-b0b3-43b9-beb3-8a7bf05b9cf1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1808 microversion: 2.20 time: 0.209022 May 19 06:38:43.748479 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 389/777] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:43 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 06:38:44.406665 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-bb8adf8a-b308-4e3f-8438-2b9be5fe5da8 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1014468999", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1671934445", "security_groups": [{"name": "tempest-secgroup-smoke-1964986703"}], "block_device_mapping_v2": [{"uuid": "4d8f40ed-71c7-4b35-92c4-17a5dcbaf564", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cf104e4d-072e-4746-a72c-c14fb907651b"}]}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:38:44.528163 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.network.neutron [None req-bb8adf8a-b308-4e3f-8438-2b9be5fe5da8 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] validate_networks() for [('cf104e4d-072e-4746-a72c-c14fb907651b', None, None, None, None, None)] {{(pid=117712) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 06:38:44.768300 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b2da15c5-4d0c-4053-929a-2cf7dc16392a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:44.768929 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b2da15c5-4d0c-4053-929a-2cf7dc16392a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:44.775574 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b2da15c5-4d0c-4053-929a-2cf7dc16392a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:44.776245 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b2da15c5-4d0c-4053-929a-2cf7dc16392a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:44.777649 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b2da15c5-4d0c-4053-929a-2cf7dc16392a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:44.778094 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b2da15c5-4d0c-4053-929a-2cf7dc16392a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:44.928097 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-bb8adf8a-b308-4e3f-8438-2b9be5fe5da8 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Flavor limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 06:38:44.928542 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-bb8adf8a-b308-4e3f-8438-2b9be5fe5da8 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Image limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 06:38:44.929445 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-bb8adf8a-b308-4e3f-8438-2b9be5fe5da8 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Flavor pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 06:38:44.930005 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-bb8adf8a-b308-4e3f-8438-2b9be5fe5da8 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Image pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 06:38:44.930528 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-bb8adf8a-b308-4e3f-8438-2b9be5fe5da8 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 06:38:44.938718 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b2da15c5-4d0c-4053-929a-2cf7dc16392a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:44.944683 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bb8adf8a-b308-4e3f-8438-2b9be5fe5da8 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:44.945260 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bb8adf8a-b308-4e3f-8438-2b9be5fe5da8 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:44.946294 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bb8adf8a-b308-4e3f-8438-2b9be5fe5da8 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:44.946836 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bb8adf8a-b308-4e3f-8438-2b9be5fe5da8 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:44.955489 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b2da15c5-4d0c-4053-929a-2cf7dc16392a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:44.957203 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b2da15c5-4d0c-4053-929a-2cf7dc16392a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:44.958783 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b2da15c5-4d0c-4053-929a-2cf7dc16392a tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1808 microversion: 2.20 time: 0.194411 May 19 06:38:44.959316 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 390/778] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:44 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 06:38:44.971440 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-bb8adf8a-b308-4e3f-8438-2b9be5fe5da8 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Getting quotas for project 318e4e0d9f3a49f69eb3d846539b6b67. Resources: {'ram', 'cores', 'instances'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:38:44.975501 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-bb8adf8a-b308-4e3f-8438-2b9be5fe5da8 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Getting quotas for user c1815cc5a2fd43259c5b53650dbc7603 and project 318e4e0d9f3a49f69eb3d846539b6b67. Resources: {'ram', 'cores', 'instances'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:38:45.043818 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-bb8adf8a-b308-4e3f-8438-2b9be5fe5da8 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Going to run 1 instances... {{(pid=117712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 06:38:45.046010 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-bb8adf8a-b308-4e3f-8438-2b9be5fe5da8 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4d8f40ed-71c7-4b35-92c4-17a5dcbaf564',volume_size=None,volume_type=None)] {{(pid=117712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 06:38:45.245325 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-bb8adf8a-b308-4e3f-8438-2b9be5fe5da8 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.842035 May 19 06:38:45.245966 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 389/779] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 06:38:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 06:38:45.263038 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-42724b48-dc6a-42d9-b051-18cd024f2ee9 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:45.264143 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-42724b48-dc6a-42d9-b051-18cd024f2ee9 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:45.363670 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-42724b48-dc6a-42d9-b051-18cd024f2ee9 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:45.380804 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-42724b48-dc6a-42d9-b051-18cd024f2ee9 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f" status: 200 len: 1095 microversion: 2.1 time: 0.125613 May 19 06:38:45.381826 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 391/780] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:38:45 2022] GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f => generated 1095 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:38:45.977750 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4752b3d1-c724-4056-9761-1bf995a74f22 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:45.978323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4752b3d1-c724-4056-9761-1bf995a74f22 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:45.986759 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4752b3d1-c724-4056-9761-1bf995a74f22 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:45.987325 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4752b3d1-c724-4056-9761-1bf995a74f22 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:45.988103 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4752b3d1-c724-4056-9761-1bf995a74f22 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:45.988522 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4752b3d1-c724-4056-9761-1bf995a74f22 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:46.130746 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-4752b3d1-c724-4056-9761-1bf995a74f22 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:46.140456 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-4752b3d1-c724-4056-9761-1bf995a74f22 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:46.141993 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-4752b3d1-c724-4056-9761-1bf995a74f22 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:46.143171 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4752b3d1-c724-4056-9761-1bf995a74f22 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1795 microversion: 2.20 time: 0.169578 May 19 06:38:46.143753 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 390/781] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:38:45 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1795 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:38:46.399790 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-9d7447ad-ead4-478a-948e-81dfd1699fe1 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:46.400405 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-9d7447ad-ead4-478a-948e-81dfd1699fe1 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:46.408358 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9d7447ad-ead4-478a-948e-81dfd1699fe1 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:46.408832 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9d7447ad-ead4-478a-948e-81dfd1699fe1 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:46.409643 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9d7447ad-ead4-478a-948e-81dfd1699fe1 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:46.410076 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9d7447ad-ead4-478a-948e-81dfd1699fe1 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:46.493924 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9d7447ad-ead4-478a-948e-81dfd1699fe1 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:46.501820 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-9d7447ad-ead4-478a-948e-81dfd1699fe1 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f" status: 200 len: 1211 microversion: 2.1 time: 0.105694 May 19 06:38:46.503805 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 392/782] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:38:46 2022] GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f => generated 1211 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:38:47.521541 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d0bef4c3-9ec6-440b-bbc8-8aeeebc59052 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:47.522205 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d0bef4c3-9ec6-440b-bbc8-8aeeebc59052 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:47.530343 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d0bef4c3-9ec6-440b-bbc8-8aeeebc59052 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:47.530892 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d0bef4c3-9ec6-440b-bbc8-8aeeebc59052 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:47.531845 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d0bef4c3-9ec6-440b-bbc8-8aeeebc59052 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:47.532281 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d0bef4c3-9ec6-440b-bbc8-8aeeebc59052 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:47.692683 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d0bef4c3-9ec6-440b-bbc8-8aeeebc59052 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:47.700522 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d0bef4c3-9ec6-440b-bbc8-8aeeebc59052 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f" status: 200 len: 1267 microversion: 2.1 time: 0.183760 May 19 06:38:47.701173 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 391/783] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:38:47 2022] GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:38:48.180236 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-56502ecd-511b-4f53-913c-7fc785dded9e req-6b2c186a-d084-47b5-b07b-57b6eb443579 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68fefa96-69e6-4e4b-86ad-b0c8bae70b5f", "tag": "a7838485-ab2f-465d-9856-c3664945b977"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:38:48.191029 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-56502ecd-511b-4f53-913c-7fc785dded9e req-6b2c186a-d084-47b5-b07b-57b6eb443579 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:48.191798 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-56502ecd-511b-4f53-913c-7fc785dded9e req-6b2c186a-d084-47b5-b07b-57b6eb443579 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:48.205927 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-56502ecd-511b-4f53-913c-7fc785dded9e req-6b2c186a-d084-47b5-b07b-57b6eb443579 service nova] Creating event network-changed:a7838485-ab2f-465d-9856-c3664945b977 for instance 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f on hv-cinder-83699 May 19 06:38:48.211478 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-56502ecd-511b-4f53-913c-7fc785dded9e req-6b2c186a-d084-47b5-b07b-57b6eb443579 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038239 May 19 06:38:48.212410 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 393/784] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:38:48.718999 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-451eb6d5-4415-4e47-a83c-489555828813 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:48.719641 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-451eb6d5-4415-4e47-a83c-489555828813 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:48.726438 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-451eb6d5-4415-4e47-a83c-489555828813 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:48.726882 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-451eb6d5-4415-4e47-a83c-489555828813 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:48.727659 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-451eb6d5-4415-4e47-a83c-489555828813 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:48.728131 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-451eb6d5-4415-4e47-a83c-489555828813 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:48.872783 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-451eb6d5-4415-4e47-a83c-489555828813 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:48.883793 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-451eb6d5-4415-4e47-a83c-489555828813 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f" status: 200 len: 1267 microversion: 2.1 time: 0.168616 May 19 06:38:48.884444 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 392/785] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:38:48 2022] GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:38:49.902981 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-10b952ad-a15f-4ef9-ba86-e35797173af7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:49.903936 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-10b952ad-a15f-4ef9-ba86-e35797173af7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:49.910349 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-10b952ad-a15f-4ef9-ba86-e35797173af7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:49.910822 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-10b952ad-a15f-4ef9-ba86-e35797173af7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:49.911587 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-10b952ad-a15f-4ef9-ba86-e35797173af7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:49.912021 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-10b952ad-a15f-4ef9-ba86-e35797173af7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:50.061786 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-10b952ad-a15f-4ef9-ba86-e35797173af7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:50.069433 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-10b952ad-a15f-4ef9-ba86-e35797173af7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f" status: 200 len: 1267 microversion: 2.1 time: 0.171641 May 19 06:38:50.069999 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 394/786] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:38:49 2022] GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:38:51.086261 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-dbf4a591-3de9-4bf0-b61d-d78d9662805c tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:51.087031 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-dbf4a591-3de9-4bf0-b61d-d78d9662805c tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:51.093965 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dbf4a591-3de9-4bf0-b61d-d78d9662805c tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:51.094417 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dbf4a591-3de9-4bf0-b61d-d78d9662805c tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:51.095434 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dbf4a591-3de9-4bf0-b61d-d78d9662805c tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:51.095970 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dbf4a591-3de9-4bf0-b61d-d78d9662805c tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:51.239598 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-dbf4a591-3de9-4bf0-b61d-d78d9662805c tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:51.247403 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-dbf4a591-3de9-4bf0-b61d-d78d9662805c tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f" status: 200 len: 1267 microversion: 2.1 time: 0.164960 May 19 06:38:51.247963 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 393/787] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:38:51 2022] GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:38:52.264939 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6dacd73a-e522-4b33-b3e7-f88246b990d6 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:52.265844 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6dacd73a-e522-4b33-b3e7-f88246b990d6 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:52.272641 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6dacd73a-e522-4b33-b3e7-f88246b990d6 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:52.273091 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6dacd73a-e522-4b33-b3e7-f88246b990d6 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:52.273881 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6dacd73a-e522-4b33-b3e7-f88246b990d6 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:52.274321 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6dacd73a-e522-4b33-b3e7-f88246b990d6 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:52.421831 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6dacd73a-e522-4b33-b3e7-f88246b990d6 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:52.430436 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6dacd73a-e522-4b33-b3e7-f88246b990d6 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f" status: 200 len: 1267 microversion: 2.1 time: 0.170100 May 19 06:38:52.435139 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 395/788] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:38:52 2022] GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:38:53.447895 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c966276b-4af1-4efe-9476-d322182d87b4 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:53.448480 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c966276b-4af1-4efe-9476-d322182d87b4 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:53.455765 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c966276b-4af1-4efe-9476-d322182d87b4 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:53.456208 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c966276b-4af1-4efe-9476-d322182d87b4 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:53.456976 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c966276b-4af1-4efe-9476-d322182d87b4 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:53.457434 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c966276b-4af1-4efe-9476-d322182d87b4 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:53.595968 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c966276b-4af1-4efe-9476-d322182d87b4 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:53.608092 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c966276b-4af1-4efe-9476-d322182d87b4 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f" status: 200 len: 1267 microversion: 2.1 time: 0.164419 May 19 06:38:53.608857 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 394/789] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:38:53 2022] GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:38:54.625718 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f64188a4-940a-4b13-a459-d7e5c097a57c tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:54.626498 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f64188a4-940a-4b13-a459-d7e5c097a57c tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:54.632799 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f64188a4-940a-4b13-a459-d7e5c097a57c tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:54.633238 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f64188a4-940a-4b13-a459-d7e5c097a57c tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:54.634037 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f64188a4-940a-4b13-a459-d7e5c097a57c tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:54.634459 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f64188a4-940a-4b13-a459-d7e5c097a57c tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:54.770900 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f64188a4-940a-4b13-a459-d7e5c097a57c tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:54.780184 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f64188a4-940a-4b13-a459-d7e5c097a57c tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f" status: 200 len: 1267 microversion: 2.1 time: 0.158476 May 19 06:38:54.780781 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 396/790] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:38:54 2022] GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:38:55.796196 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c36ecc76-fe35-46d8-a5ad-84be953f0661 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:55.796750 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c36ecc76-fe35-46d8-a5ad-84be953f0661 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:55.799267 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:38:55.799941 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=6 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:38:55.805962 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c36ecc76-fe35-46d8-a5ad-84be953f0661 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:55.806409 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c36ecc76-fe35-46d8-a5ad-84be953f0661 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:55.807179 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c36ecc76-fe35-46d8-a5ad-84be953f0661 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:55.807615 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c36ecc76-fe35-46d8-a5ad-84be953f0661 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:55.941330 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c36ecc76-fe35-46d8-a5ad-84be953f0661 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:55.948726 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c36ecc76-fe35-46d8-a5ad-84be953f0661 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f" status: 200 len: 1267 microversion: 2.1 time: 0.156537 May 19 06:38:55.950081 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 395/791] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:38:55 2022] GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:38:56.966607 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ce950ed5-42c4-4a9b-a5ac-07083a8823e8 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:56.967249 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ce950ed5-42c4-4a9b-a5ac-07083a8823e8 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:56.969383 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:38:56.975298 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ce950ed5-42c4-4a9b-a5ac-07083a8823e8 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:56.975672 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ce950ed5-42c4-4a9b-a5ac-07083a8823e8 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:56.976502 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ce950ed5-42c4-4a9b-a5ac-07083a8823e8 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:56.976935 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ce950ed5-42c4-4a9b-a5ac-07083a8823e8 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:57.010575 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-a86465a1-0656-48f1-a93b-7d8ee9a2536d req-d3f64a8e-85f7-4cc5-b784-68b029589612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68fefa96-69e6-4e4b-86ad-b0c8bae70b5f", "name": "network-vif-plugged", "status": "completed", "tag": "a7838485-ab2f-465d-9856-c3664945b977"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:38:57.020907 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-a86465a1-0656-48f1-a93b-7d8ee9a2536d req-d3f64a8e-85f7-4cc5-b784-68b029589612 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:57.021626 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-a86465a1-0656-48f1-a93b-7d8ee9a2536d req-d3f64a8e-85f7-4cc5-b784-68b029589612 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:57.037520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-a86465a1-0656-48f1-a93b-7d8ee9a2536d req-d3f64a8e-85f7-4cc5-b784-68b029589612 service nova] Creating event network-vif-plugged:a7838485-ab2f-465d-9856-c3664945b977 for instance 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f on hv-cinder-83699 May 19 06:38:57.043167 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-a86465a1-0656-48f1-a93b-7d8ee9a2536d req-d3f64a8e-85f7-4cc5-b784-68b029589612 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036654 May 19 06:38:57.045135 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 396/792] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:38:57.134487 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ce950ed5-42c4-4a9b-a5ac-07083a8823e8 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:57.142590 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ce950ed5-42c4-4a9b-a5ac-07083a8823e8 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f" status: 200 len: 1267 microversion: 2.1 time: 0.180312 May 19 06:38:57.143176 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 397/793] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:38:56 2022] GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:38:57.835175 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-08e456db-3fee-4e6d-9ec6-3f812092226a tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56931001-043a-433f-843f-4bed2baf48e9", "device": "/dev/sdb"}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:38:57.836829 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-08e456db-3fee-4e6d-9ec6-3f812092226a tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 9b11d98c-676f-43a9-8d2b-f052a0d614be] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:57.844198 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-08e456db-3fee-4e6d-9ec6-3f812092226a tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:57.844641 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-08e456db-3fee-4e6d-9ec6-3f812092226a tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:57.845438 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-08e456db-3fee-4e6d-9ec6-3f812092226a tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:57.845901 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-08e456db-3fee-4e6d-9ec6-3f812092226a tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:58.052399 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:38:58.160035 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-65efca40-720f-4445-a19c-546a8f90d917 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:58.160723 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-65efca40-720f-4445-a19c-546a8f90d917 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:58.167820 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-65efca40-720f-4445-a19c-546a8f90d917 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:58.168954 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-65efca40-720f-4445-a19c-546a8f90d917 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:58.169889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-65efca40-720f-4445-a19c-546a8f90d917 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:58.170405 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-65efca40-720f-4445-a19c-546a8f90d917 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:58.182693 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-08e456db-3fee-4e6d-9ec6-3f812092226a tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "POST /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.351667 May 19 06:38:58.183337 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 397/794] 10.222.0.65 () {60 vars in 1322 bytes} [Thu May 19 06:38:57 2022] POST /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be/os-volume_attachments => generated 194 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:38:58.350743 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-65efca40-720f-4445-a19c-546a8f90d917 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:58.358999 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-65efca40-720f-4445-a19c-546a8f90d917 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f" status: 200 len: 1267 microversion: 2.1 time: 0.202955 May 19 06:38:58.359578 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 398/795] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:38:58 2022] GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f => generated 1267 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:38:59.379105 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-95bd3ed9-a0b9-4921-965a-ae3393e8a7a7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:59.380873 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-95bd3ed9-a0b9-4921-965a-ae3393e8a7a7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:59.388979 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-95bd3ed9-a0b9-4921-965a-ae3393e8a7a7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:59.389523 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-95bd3ed9-a0b9-4921-965a-ae3393e8a7a7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:59.390309 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-95bd3ed9-a0b9-4921-965a-ae3393e8a7a7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:59.391328 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-95bd3ed9-a0b9-4921-965a-ae3393e8a7a7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:59.562584 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-95bd3ed9-a0b9-4921-965a-ae3393e8a7a7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:59.570500 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-95bd3ed9-a0b9-4921-965a-ae3393e8a7a7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f" status: 200 len: 1454 microversion: 2.1 time: 0.198358 May 19 06:38:59.571089 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 398/796] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:38:59 2022] GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f => generated 1454 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:38:59.588972 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a187faaa-7aef-4e9a-ba38-d59a34a98c0d tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:38:59.589614 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a187faaa-7aef-4e9a-ba38-d59a34a98c0d tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:38:59.596741 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a187faaa-7aef-4e9a-ba38-d59a34a98c0d tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:59.597190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a187faaa-7aef-4e9a-ba38-d59a34a98c0d tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:59.598039 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a187faaa-7aef-4e9a-ba38-d59a34a98c0d tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:38:59.598420 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a187faaa-7aef-4e9a-ba38-d59a34a98c0d tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:38:59.757506 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a187faaa-7aef-4e9a-ba38-d59a34a98c0d tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:38:59.773188 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a187faaa-7aef-4e9a-ba38-d59a34a98c0d tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f" status: 200 len: 1454 microversion: 2.1 time: 0.187575 May 19 06:38:59.774409 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 399/797] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:38:59 2022] GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f => generated 1454 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:39:01.605342 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-7b640051-5d1f-496e-afb8-b6291a0acfcf req-9177fdd4-adbd-4078-af16-ba75239b72c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68fefa96-69e6-4e4b-86ad-b0c8bae70b5f", "tag": "a7838485-ab2f-465d-9856-c3664945b977"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:39:01.615063 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-7b640051-5d1f-496e-afb8-b6291a0acfcf req-9177fdd4-adbd-4078-af16-ba75239b72c8 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:01.615643 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-7b640051-5d1f-496e-afb8-b6291a0acfcf req-9177fdd4-adbd-4078-af16-ba75239b72c8 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:01.627271 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-7b640051-5d1f-496e-afb8-b6291a0acfcf req-9177fdd4-adbd-4078-af16-ba75239b72c8 service nova] Creating event network-changed:a7838485-ab2f-465d-9856-c3664945b977 for instance 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f on hv-cinder-83699 May 19 06:39:01.632369 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-7b640051-5d1f-496e-afb8-b6291a0acfcf req-9177fdd4-adbd-4078-af16-ba75239b72c8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030766 May 19 06:39:01.633315 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 399/798] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:39:20.893923 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-83ebc5f4-69d8-4cb9-a4c1-50e071459478 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:20.894481 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-83ebc5f4-69d8-4cb9-a4c1-50e071459478 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 9b11d98c-676f-43a9-8d2b-f052a0d614be] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:20.896602 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=35 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:39:20.897493 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=93 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:39:20.903783 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-83ebc5f4-69d8-4cb9-a4c1-50e071459478 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:20.904590 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-83ebc5f4-69d8-4cb9-a4c1-50e071459478 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:20.906164 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-83ebc5f4-69d8-4cb9-a4c1-50e071459478 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:20.906601 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-83ebc5f4-69d8-4cb9-a4c1-50e071459478 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:20.987354 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-83ebc5f4-69d8-4cb9-a4c1-50e071459478 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lazy-loading 'services' on Instance uuid 9b11d98c-676f-43a9-8d2b-f052a0d614be {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:39:21.057392 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-83ebc5f4-69d8-4cb9-a4c1-50e071459478 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be/os-volume_attachments/56931001-043a-433f-843f-4bed2baf48e9" status: 202 len: 0 microversion: 2.1 time: 0.167270 May 19 06:39:21.057994 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 400/799] 10.222.0.65 () {58 vars in 1415 bytes} [Thu May 19 06:39:20 2022] DELETE /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be/os-volume_attachments/56931001-043a-433f-843f-4bed2baf48e9 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 06:39:22.177302 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:39:22.178045 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:39:22.182397 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-92ad111d-f428-4a2e-b859-a8f99a1e7549 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:22.182978 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-92ad111d-f428-4a2e-b859-a8f99a1e7549 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 9b11d98c-676f-43a9-8d2b-f052a0d614be] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:22.192293 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-92ad111d-f428-4a2e-b859-a8f99a1e7549 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:22.192777 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-92ad111d-f428-4a2e-b859-a8f99a1e7549 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:22.193558 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-92ad111d-f428-4a2e-b859-a8f99a1e7549 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:22.193991 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-92ad111d-f428-4a2e-b859-a8f99a1e7549 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:22.220053 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-92ad111d-f428-4a2e-b859-a8f99a1e7549 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 9b11d98c-676f-43a9-8d2b-f052a0d614be] Going to try to terminate instance {{(pid=117712) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 06:39:22.294347 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-92ad111d-f428-4a2e-b859-a8f99a1e7549 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be" status: 204 len: 0 microversion: 2.1 time: 0.118344 May 19 06:39:22.295181 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 400/800] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 06:39:22 2022] DELETE /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 06:39:22.304886 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e8252f9c-62c9-409d-a6f2-cf92d7859a3f tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:22.305596 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e8252f9c-62c9-409d-a6f2-cf92d7859a3f tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 9b11d98c-676f-43a9-8d2b-f052a0d614be] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:22.312097 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e8252f9c-62c9-409d-a6f2-cf92d7859a3f tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:22.312818 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e8252f9c-62c9-409d-a6f2-cf92d7859a3f tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:22.313643 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e8252f9c-62c9-409d-a6f2-cf92d7859a3f tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:22.314075 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e8252f9c-62c9-409d-a6f2-cf92d7859a3f tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:22.454418 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e8252f9c-62c9-409d-a6f2-cf92d7859a3f tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cde6f1714941f9a0a094332eae9404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887496db011b48b5a8a5f2da6d8c5e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:22.461818 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e8252f9c-62c9-409d-a6f2-cf92d7859a3f tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be" status: 200 len: 1513 microversion: 2.1 time: 0.161914 May 19 06:39:22.462373 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 401/801] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:39:22 2022] GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:39:23.480298 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d0069822-a68b-4f9c-a9dc-acf86432339d tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:23.480994 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d0069822-a68b-4f9c-a9dc-acf86432339d tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 9b11d98c-676f-43a9-8d2b-f052a0d614be] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:23.488188 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d0069822-a68b-4f9c-a9dc-acf86432339d tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:23.488630 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d0069822-a68b-4f9c-a9dc-acf86432339d tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:23.489411 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d0069822-a68b-4f9c-a9dc-acf86432339d tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:23.489841 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d0069822-a68b-4f9c-a9dc-acf86432339d tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:23.624631 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d0069822-a68b-4f9c-a9dc-acf86432339d tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cde6f1714941f9a0a094332eae9404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887496db011b48b5a8a5f2da6d8c5e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:23.633680 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d0069822-a68b-4f9c-a9dc-acf86432339d tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be" status: 200 len: 1513 microversion: 2.1 time: 0.157565 May 19 06:39:23.634291 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 401/802] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:39:23 2022] GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:39:24.448630 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-52d23919-f9c9-46c6-83c6-c47cf16193dc req-52c8d1c0-1cfa-44b4-b47c-926c075420df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b11d98c-676f-43a9-8d2b-f052a0d614be", "name": "network-vif-deleted", "tag": "e403aee9-b9e1-4257-a333-441e2cafc81b"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:39:24.460218 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-52d23919-f9c9-46c6-83c6-c47cf16193dc req-52c8d1c0-1cfa-44b4-b47c-926c075420df service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:24.460831 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-52d23919-f9c9-46c6-83c6-c47cf16193dc req-52c8d1c0-1cfa-44b4-b47c-926c075420df service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:24.475432 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-52d23919-f9c9-46c6-83c6-c47cf16193dc req-52c8d1c0-1cfa-44b4-b47c-926c075420df service nova] Creating event network-vif-deleted:e403aee9-b9e1-4257-a333-441e2cafc81b for instance 9b11d98c-676f-43a9-8d2b-f052a0d614be on hv-cinder-83699 May 19 06:39:24.481151 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-52d23919-f9c9-46c6-83c6-c47cf16193dc req-52c8d1c0-1cfa-44b4-b47c-926c075420df service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036229 May 19 06:39:24.481808 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 402/803] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:39:24.651198 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-44f61e67-5df2-4d7f-9a46-81ac95c1de83 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:24.651800 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-44f61e67-5df2-4d7f-9a46-81ac95c1de83 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 9b11d98c-676f-43a9-8d2b-f052a0d614be] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:24.658902 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-44f61e67-5df2-4d7f-9a46-81ac95c1de83 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:24.659382 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-44f61e67-5df2-4d7f-9a46-81ac95c1de83 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:24.660153 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-44f61e67-5df2-4d7f-9a46-81ac95c1de83 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:24.660589 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-44f61e67-5df2-4d7f-9a46-81ac95c1de83 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:24.699399 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-44f61e67-5df2-4d7f-9a46-81ac95c1de83 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:24.699847 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-44f61e67-5df2-4d7f-9a46-81ac95c1de83 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:24.700311 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-44f61e67-5df2-4d7f-9a46-81ac95c1de83 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lazy-loading 'fault' on Instance uuid 9b11d98c-676f-43a9-8d2b-f052a0d614be {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:39:24.743931 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-44f61e67-5df2-4d7f-9a46-81ac95c1de83 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cde6f1714941f9a0a094332eae9404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887496db011b48b5a8a5f2da6d8c5e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:24.752972 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-44f61e67-5df2-4d7f-9a46-81ac95c1de83 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be" status: 200 len: 1308 microversion: 2.1 time: 0.105804 May 19 06:39:24.753579 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 402/804] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:39:24 2022] GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:39:25.771473 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ad24bafe-d12a-4221-932d-2a99fe46c92e tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:25.772160 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ad24bafe-d12a-4221-932d-2a99fe46c92e tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 9b11d98c-676f-43a9-8d2b-f052a0d614be] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:25.778353 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ad24bafe-d12a-4221-932d-2a99fe46c92e tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:25.778789 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ad24bafe-d12a-4221-932d-2a99fe46c92e tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:25.779789 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ad24bafe-d12a-4221-932d-2a99fe46c92e tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:25.780215 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ad24bafe-d12a-4221-932d-2a99fe46c92e tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:25.793081 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-ad24bafe-d12a-4221-932d-2a99fe46c92e tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] HTTP exception thrown: Instance 9b11d98c-676f-43a9-8d2b-f052a0d614be could not be found. May 19 06:39:25.794728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ad24bafe-d12a-4221-932d-2a99fe46c92e tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Request method failure captured: May 19 06:39:25.794728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be HTTP/1.1 May 19 06:39:25.794728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:39:25.794728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:39:25.794728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:39:25.794728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 0 May 19 06:39:25.794728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:39:25.794728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:39:25.794728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:39:25.794728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:39:25.794728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheXeYFkRnwCOg4n2h7UHhPJY7b7CKJNTXB87bJwFO_b67ClCblyPZnm8XU4ycwK1OARuGtIdHYjf65V-NjDVd8U2p5t61lMYT58I56AH-uPDcXZhkzv0fZRVlVYbRD7OD79a1oa0tZ9FkxEyFSKDMyn1hoYGPL2OqXmtXbB2TQxGUTg May 19 06:39:25.794728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:39:25.794728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:39:25.794728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:39:25.794728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:39:25.794728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:39:25.794728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:39:25.794728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: 887496db011b48b5a8a5f2da6d8c5e44 May 19 06:39:25.794728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1620388866 May 19 06:39:25.794728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:39:25.794728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:39:25.796653 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/887496db011b48b5a8a5f2da6d8c5e44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/887496db011b48b5a8a5f2da6d8c5e44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/887496db011b48b5a8a5f2da6d8c5e44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_887496db011b48b5a8a5f2da6d8c5e44", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:39:25.796653 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-VolumesSnapshotTestJSON-1620388866 May 19 06:39:25.796653 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: 887496db011b48b5a8a5f2da6d8c5e44 May 19 06:39:25.796653 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1620388866 May 19 06:39:25.796653 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-VolumesSnapshotTestJSON-1620388866-project May 19 06:39:25.796653 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:39:25.796653 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:39:25.796653 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: 87cde6f1714941f9a0a094332eae9404 May 19 06:39:25.796653 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-VolumesSnapshotTestJSON-1620388866-project May 19 06:39:25.796653 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: > May 19 06:39:25.796653 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Instance 9b11d98c-676f-43a9-8d2b-f052a0d614be could not be found. May 19 06:39:25.796653 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'id': '9b11d98c-676f-43a9-8d2b-f052a0d614be'} May 19 06:39:25.797759 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:39:25.797759 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:39:25.797759 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:39:25.797759 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:39:25.797759 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:39:25.797759 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:39:25.797759 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:39:25.797759 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:39:25.797759 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:39:25.797759 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:39:25.797759 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b11d98c-676f-43a9-8d2b-f052a0d614be could not be found. May 19 06:39:25.797759 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:39:25.797759 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:39:25.797759 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:39:25.797759 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:39:25.797759 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:39:25.797759 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:39:25.797759 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:39:25.797759 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:39:25.797759 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:39:25.799429 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:39:25.799429 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:39:25.799429 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:39:25.799429 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:39:25.799429 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:39:25.799429 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:39:25.799429 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:39:25.799429 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b11d98c-676f-43a9-8d2b-f052a0d614be could not be found. May 19 06:39:25.799429 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:39:25.799429 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:39:25.799429 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:39:25.799429 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:39:25.799429 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:39:25.799429 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:39:25.799429 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:39:25.799429 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:39:25.799429 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b11d98c-676f-43a9-8d2b-f052a0d614be could not be found. May 19 06:39:25.799429 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:39:25.800905 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ad24bafe-d12a-4221-932d-2a99fe46c92e tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Returning 404 to user: Instance 9b11d98c-676f-43a9-8d2b-f052a0d614be could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:39:25.800905 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ad24bafe-d12a-4221-932d-2a99fe46c92e tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be" status: 404 len: 111 microversion: 2.1 time: 0.029213 May 19 06:39:25.800905 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 403/805] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:39:25 2022] GET /compute/v2.1/servers/9b11d98c-676f-43a9-8d2b-f052a0d614be => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:39:28.900608 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-45528f89-51a1-4601-a9fb-778c06d1f58b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:28.901241 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-45528f89-51a1-4601-a9fb-778c06d1f58b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:28.908552 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-45528f89-51a1-4601-a9fb-778c06d1f58b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:28.908996 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-45528f89-51a1-4601-a9fb-778c06d1f58b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:28.909793 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-45528f89-51a1-4601-a9fb-778c06d1f58b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:28.910221 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-45528f89-51a1-4601-a9fb-778c06d1f58b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:28.941761 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-45528f89-51a1-4601-a9fb-778c06d1f58b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454/os-volume_attachments/bf9ce5e4-ba8f-4793-9c07-ade448e5676f" status: 200 len: 194 microversion: 2.20 time: 0.046248 May 19 06:39:28.942474 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 403/806] 10.222.0.65 () {60 vars in 1453 bytes} [Thu May 19 06:39:28 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454/os-volume_attachments/bf9ce5e4-ba8f-4793-9c07-ade448e5676f => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 06:39:29.008716 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6ba2499b-df42-49b6-b454-5a41410c3f6c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:29.009270 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6ba2499b-df42-49b6-b454-5a41410c3f6c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:29.016546 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6ba2499b-df42-49b6-b454-5a41410c3f6c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:29.017069 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6ba2499b-df42-49b6-b454-5a41410c3f6c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:29.017991 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6ba2499b-df42-49b6-b454-5a41410c3f6c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:29.018479 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6ba2499b-df42-49b6-b454-5a41410c3f6c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:29.114287 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-6ba2499b-df42-49b6-b454-5a41410c3f6c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lazy-loading 'services' on Instance uuid 06323e6f-7b35-407f-aecf-5435fa013454 {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:39:29.195742 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6ba2499b-df42-49b6-b454-5a41410c3f6c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "DELETE /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454/os-volume_attachments/bf9ce5e4-ba8f-4793-9c07-ade448e5676f" status: 202 len: 0 microversion: 2.20 time: 0.190885 May 19 06:39:29.196317 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 404/807] 10.222.0.65 () {60 vars in 1456 bytes} [Thu May 19 06:39:29 2022] DELETE /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454/os-volume_attachments/bf9ce5e4-ba8f-4793-9c07-ade448e5676f => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 19 06:39:29.205939 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-19f89572-784f-4a2c-a5d0-0db60a92da9c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:29.207143 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-19f89572-784f-4a2c-a5d0-0db60a92da9c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:29.213603 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-19f89572-784f-4a2c-a5d0-0db60a92da9c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:29.214404 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-19f89572-784f-4a2c-a5d0-0db60a92da9c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:29.215417 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-19f89572-784f-4a2c-a5d0-0db60a92da9c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:29.215930 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-19f89572-784f-4a2c-a5d0-0db60a92da9c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:29.250917 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-19f89572-784f-4a2c-a5d0-0db60a92da9c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048744 May 19 06:39:29.251510 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 404/808] 10.222.0.65 () {60 vars in 1342 bytes} [Thu May 19 06:39:29 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 06:39:30.002324 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 06:39:30.002619 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Thu May 19 06:39:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 06:39:30.263958 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b74d53ae-3075-4988-a28d-14d5751e8325 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:30.266540 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b74d53ae-3075-4988-a28d-14d5751e8325 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:30.275644 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b74d53ae-3075-4988-a28d-14d5751e8325 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:30.276083 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b74d53ae-3075-4988-a28d-14d5751e8325 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:30.276852 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b74d53ae-3075-4988-a28d-14d5751e8325 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:30.277297 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b74d53ae-3075-4988-a28d-14d5751e8325 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:30.309015 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b74d53ae-3075-4988-a28d-14d5751e8325 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049941 May 19 06:39:30.309618 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 405/809] 10.222.0.65 () {60 vars in 1342 bytes} [Thu May 19 06:39:30 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:39:30.371526 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-594f87f1-fc5b-4a52-aa0c-d11c08fca967 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:30.372100 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-594f87f1-fc5b-4a52-aa0c-d11c08fca967 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:30.379785 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-594f87f1-fc5b-4a52-aa0c-d11c08fca967 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:30.379785 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-594f87f1-fc5b-4a52-aa0c-d11c08fca967 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:30.380609 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-594f87f1-fc5b-4a52-aa0c-d11c08fca967 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:30.381066 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-594f87f1-fc5b-4a52-aa0c-d11c08fca967 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:30.409152 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-594f87f1-fc5b-4a52-aa0c-d11c08fca967 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Going to try to terminate instance {{(pid=117712) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 06:39:30.512340 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-594f87f1-fc5b-4a52-aa0c-d11c08fca967 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "DELETE /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 204 len: 0 microversion: 2.20 time: 0.144327 May 19 06:39:30.513007 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 405/810] 10.222.0.65 () {60 vars in 1279 bytes} [Thu May 19 06:39:30 2022] DELETE /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 19 06:39:30.521445 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7ade9fef-738e-4d43-860f-38ddfd819746 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:30.521987 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7ade9fef-738e-4d43-860f-38ddfd819746 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:30.527928 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7ade9fef-738e-4d43-860f-38ddfd819746 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:30.528366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7ade9fef-738e-4d43-860f-38ddfd819746 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:30.529118 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7ade9fef-738e-4d43-860f-38ddfd819746 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:30.529830 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7ade9fef-738e-4d43-860f-38ddfd819746 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:30.664535 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7ade9fef-738e-4d43-860f-38ddfd819746 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:30.672454 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7ade9fef-738e-4d43-860f-38ddfd819746 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:30.674088 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7ade9fef-738e-4d43-860f-38ddfd819746 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:30.675242 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7ade9fef-738e-4d43-860f-38ddfd819746 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1723 microversion: 2.20 time: 0.157829 May 19 06:39:30.675797 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 406/811] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:39:30 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:39:31.694368 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e6e2ac6c-d753-4ef1-bbb7-a0d9fd692073 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:31.695070 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e6e2ac6c-d753-4ef1-bbb7-a0d9fd692073 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:31.702150 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e6e2ac6c-d753-4ef1-bbb7-a0d9fd692073 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:31.702640 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e6e2ac6c-d753-4ef1-bbb7-a0d9fd692073 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:31.703399 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e6e2ac6c-d753-4ef1-bbb7-a0d9fd692073 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:31.703829 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e6e2ac6c-d753-4ef1-bbb7-a0d9fd692073 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:31.833847 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e6e2ac6c-d753-4ef1-bbb7-a0d9fd692073 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:31.842024 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e6e2ac6c-d753-4ef1-bbb7-a0d9fd692073 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:31.844066 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e6e2ac6c-d753-4ef1-bbb7-a0d9fd692073 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:31.845231 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e6e2ac6c-d753-4ef1-bbb7-a0d9fd692073 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1723 microversion: 2.20 time: 0.155232 May 19 06:39:31.845815 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 406/812] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:39:31 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:39:32.864013 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-95a91d4b-14ec-4b7e-8c04-43cc29c4b59e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:32.864765 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-95a91d4b-14ec-4b7e-8c04-43cc29c4b59e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:32.871870 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-95a91d4b-14ec-4b7e-8c04-43cc29c4b59e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:32.872315 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-95a91d4b-14ec-4b7e-8c04-43cc29c4b59e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:32.873084 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-95a91d4b-14ec-4b7e-8c04-43cc29c4b59e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:32.873592 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-95a91d4b-14ec-4b7e-8c04-43cc29c4b59e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:33.011237 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-95a91d4b-14ec-4b7e-8c04-43cc29c4b59e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:33.019334 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-95a91d4b-14ec-4b7e-8c04-43cc29c4b59e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:33.020834 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-95a91d4b-14ec-4b7e-8c04-43cc29c4b59e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:33.022015 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-95a91d4b-14ec-4b7e-8c04-43cc29c4b59e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1723 microversion: 2.20 time: 0.161945 May 19 06:39:33.022570 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 407/813] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:39:32 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:39:33.632683 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-34d762fb-77c3-48d2-9ade-065b7b0759bc tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-950524715", "imageRef": "27959167-098e-44c5-ba0a-e9fb8054c377", "flavorRef": "452", "networks": [{"uuid": "87d6fb60-2cd1-43b1-8e28-e6a214bcc197"}]}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:39:33.697075 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.network.neutron [None req-34d762fb-77c3-48d2-9ade-065b7b0759bc tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] validate_networks() for [('87d6fb60-2cd1-43b1-8e28-e6a214bcc197', None, None, None, None, None)] {{(pid=117712) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 06:39:34.043485 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1c16b2d4-b9e6-4367-aa39-c7f3a815efba tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:34.045567 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-1c16b2d4-b9e6-4367-aa39-c7f3a815efba tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:34.060367 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1c16b2d4-b9e6-4367-aa39-c7f3a815efba tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:34.060824 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1c16b2d4-b9e6-4367-aa39-c7f3a815efba tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:34.061651 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1c16b2d4-b9e6-4367-aa39-c7f3a815efba tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:34.064038 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1c16b2d4-b9e6-4367-aa39-c7f3a815efba tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:34.098037 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-34d762fb-77c3-48d2-9ade-065b7b0759bc tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Flavor limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 06:39:34.098759 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-34d762fb-77c3-48d2-9ade-065b7b0759bc tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Image limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 06:39:34.099667 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-34d762fb-77c3-48d2-9ade-065b7b0759bc tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Flavor pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 06:39:34.100293 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-34d762fb-77c3-48d2-9ade-065b7b0759bc tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Image pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 06:39:34.101763 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-34d762fb-77c3-48d2-9ade-065b7b0759bc tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 06:39:34.123016 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-34d762fb-77c3-48d2-9ade-065b7b0759bc tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:34.123548 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-34d762fb-77c3-48d2-9ade-065b7b0759bc tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:34.125057 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-34d762fb-77c3-48d2-9ade-065b7b0759bc tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:34.125777 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-34d762fb-77c3-48d2-9ade-065b7b0759bc tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:34.145743 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-34d762fb-77c3-48d2-9ade-065b7b0759bc tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Getting quotas for project 887496db011b48b5a8a5f2da6d8c5e44. Resources: {'ram', 'cores', 'instances'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:39:34.150627 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-34d762fb-77c3-48d2-9ade-065b7b0759bc tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Getting quotas for user 87cde6f1714941f9a0a094332eae9404 and project 887496db011b48b5a8a5f2da6d8c5e44. Resources: {'ram', 'cores', 'instances'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:39:34.163541 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-34d762fb-77c3-48d2-9ade-065b7b0759bc tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Going to run 1 instances... {{(pid=117712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 06:39:34.165911 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-34d762fb-77c3-48d2-9ade-065b7b0759bc tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 59a72f2f-7a49-47cf-9adc-d341fb74fdda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27959167-098e-44c5-ba0a-e9fb8054c377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 06:39:34.212809 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-34d762fb-77c3-48d2-9ade-065b7b0759bc tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.584367 May 19 06:39:34.218732 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 407/814] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 06:39:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 06:39:34.224277 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-350bd288-f7b0-4f35-87e6-efa191f93618 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:34.224932 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-350bd288-f7b0-4f35-87e6-efa191f93618 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 59a72f2f-7a49-47cf-9adc-d341fb74fdda] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:34.308682 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1c16b2d4-b9e6-4367-aa39-c7f3a815efba tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:34.314112 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-350bd288-f7b0-4f35-87e6-efa191f93618 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cde6f1714941f9a0a094332eae9404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887496db011b48b5a8a5f2da6d8c5e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:34.323080 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-350bd288-f7b0-4f35-87e6-efa191f93618 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda" status: 200 len: 1218 microversion: 2.1 time: 0.103180 May 19 06:39:34.324048 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 408/815] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:39:34 2022] GET /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:39:34.327084 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1c16b2d4-b9e6-4367-aa39-c7f3a815efba tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:34.329537 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1c16b2d4-b9e6-4367-aa39-c7f3a815efba tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:34.331257 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-1c16b2d4-b9e6-4367-aa39-c7f3a815efba tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 200 len: 1723 microversion: 2.20 time: 0.294866 May 19 06:39:34.343529 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 408/816] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:39:34 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 1723 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 06:39:34.704988 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-a2cbb797-c828-460f-ae1b-bcafc30d4e48 req-8614b04d-76fb-4476-a0bf-a069b40be1d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06323e6f-7b35-407f-aecf-5435fa013454", "name": "network-vif-deleted", "tag": "b967f972-267a-488a-a383-8186a8a77201"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:39:34.714802 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-a2cbb797-c828-460f-ae1b-bcafc30d4e48 req-8614b04d-76fb-4476-a0bf-a069b40be1d3 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:34.715354 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-a2cbb797-c828-460f-ae1b-bcafc30d4e48 req-8614b04d-76fb-4476-a0bf-a069b40be1d3 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:34.731587 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-a2cbb797-c828-460f-ae1b-bcafc30d4e48 req-8614b04d-76fb-4476-a0bf-a069b40be1d3 service nova] Creating event network-vif-deleted:b967f972-267a-488a-a383-8186a8a77201 for instance 06323e6f-7b35-407f-aecf-5435fa013454 on hv-cinder-83699 May 19 06:39:34.737130 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-a2cbb797-c828-460f-ae1b-bcafc30d4e48 req-8614b04d-76fb-4476-a0bf-a069b40be1d3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036216 May 19 06:39:34.741585 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 409/817] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:39:35.357757 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-498151a5-c174-4d38-99b3-0f3af4d7c597 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:35.358502 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a27dbd9d-11f0-48a8-b1c2-cc2e5268b1e4 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:35.360991 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a27dbd9d-11f0-48a8-b1c2-cc2e5268b1e4 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 59a72f2f-7a49-47cf-9adc-d341fb74fdda] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:35.363888 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-498151a5-c174-4d38-99b3-0f3af4d7c597 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:35.380385 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-498151a5-c174-4d38-99b3-0f3af4d7c597 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:35.382275 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a27dbd9d-11f0-48a8-b1c2-cc2e5268b1e4 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:35.382979 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-498151a5-c174-4d38-99b3-0f3af4d7c597 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:35.383561 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a27dbd9d-11f0-48a8-b1c2-cc2e5268b1e4 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:35.385200 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a27dbd9d-11f0-48a8-b1c2-cc2e5268b1e4 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:35.386271 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-498151a5-c174-4d38-99b3-0f3af4d7c597 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:35.393687 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a27dbd9d-11f0-48a8-b1c2-cc2e5268b1e4 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:35.394031 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-498151a5-c174-4d38-99b3-0f3af4d7c597 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:35.411241 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-498151a5-c174-4d38-99b3-0f3af4d7c597 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] HTTP exception thrown: Instance 06323e6f-7b35-407f-aecf-5435fa013454 could not be found. May 19 06:39:35.426434 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-498151a5-c174-4d38-99b3-0f3af4d7c597 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Request method failure captured: May 19 06:39:35.426434 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 HTTP/1.1 May 19 06:39:35.426434 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept: application/json May 19 06:39:35.426434 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity May 19 06:39:35.426434 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Connection: close May 19 06:39:35.426434 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Length: 0 May 19 06:39:35.426434 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Type: application/json May 19 06:39:35.426434 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Host: 10.222.0.65 May 19 06:39:35.426434 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None May 19 06:39:35.426434 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 May 19 06:39:35.426434 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiheWD6cQhjZG-XwixYSXIkUEMkJ-sOE63Sa9pijFv9NBliLzJlR7V-ObuT2TtIZVIefICt7JgdZX4HH0xGivixZxbQmE2Hv2v4q2Q-vgaVY7mFxaKWhSBXCUQTru8LLX4DjdP7YGJWOJAJhTcdsulI-9frBxJlpkQotDIqllulRNMLs0 May 19 06:39:35.426434 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Id: None May 19 06:39:35.426434 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Name: None May 19 06:39:35.426434 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed May 19 06:39:35.426434 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True May 19 06:39:35.426434 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Openstack-Nova-Api-Version: 2.20 May 19 06:39:35.426434 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default May 19 06:39:35.426434 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default May 19 06:39:35.426434 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Id: e21ed8d40dab40828a1fc685ca63ad92 May 19 06:39:35.426434 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-125467305 May 19 06:39:35.426434 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Role: reader,member May 19 06:39:35.426434 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Roles: reader,member May 19 06:39:35.428264 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e21ed8d40dab40828a1fc685ca63ad92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e21ed8d40dab40828a1fc685ca63ad92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e21ed8d40dab40828a1fc685ca63ad92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e21ed8d40dab40828a1fc685ca63ad92", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:39:35.428264 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-AttachVolumeShelveTestJSON-125467305 May 19 06:39:35.428264 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Id: e21ed8d40dab40828a1fc685ca63ad92 May 19 06:39:35.428264 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-125467305 May 19 06:39:35.428264 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User: tempest-AttachVolumeShelveTestJSON-125467305-project May 19 06:39:35.428264 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default May 19 06:39:35.428264 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default May 19 06:39:35.428264 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Id: 3a8abbf889e149f5be25ecddb22384a5 May 19 06:39:35.428264 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-AttachVolumeShelveTestJSON-125467305-project May 19 06:39:35.428264 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: method: > May 19 06:39:35.428264 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: exception: Instance 06323e6f-7b35-407f-aecf-5435fa013454 could not be found. May 19 06:39:35.428264 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: action_args: {'id': '06323e6f-7b35-407f-aecf-5435fa013454'} May 19 06:39:35.429275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:39:35.429275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:39:35.429275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:39:35.429275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:39:35.429275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:39:35.429275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:39:35.429275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:39:35.429275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:39:35.429275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:39:35.429275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:39:35.429275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06323e6f-7b35-407f-aecf-5435fa013454 could not be found. May 19 06:39:35.429275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:39:35.429275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:39:35.429275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:39:35.429275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:39:35.429275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:39:35.429275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:39:35.429275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:39:35.429275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:39:35.429275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:39:35.431520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:39:35.431520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:39:35.431520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:39:35.431520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:39:35.431520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:39:35.431520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:39:35.431520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:39:35.431520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06323e6f-7b35-407f-aecf-5435fa013454 could not be found. May 19 06:39:35.431520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:39:35.431520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:39:35.431520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:39:35.431520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:39:35.431520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:39:35.431520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:39:35.431520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:39:35.431520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:39:35.431520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06323e6f-7b35-407f-aecf-5435fa013454 could not be found. May 19 06:39:35.431520 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:39:35.433201 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-498151a5-c174-4d38-99b3-0f3af4d7c597 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Returning 404 to user: Instance 06323e6f-7b35-407f-aecf-5435fa013454 could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:39:35.433201 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-498151a5-c174-4d38-99b3-0f3af4d7c597 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 404 len: 111 microversion: 2.20 time: 0.078495 May 19 06:39:35.433201 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 410/818] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:39:35 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 06:39:35.440556 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-8ff0d31f-7490-442a-838b-abd20567246e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '.version_select at 0x7f9aeabe7040>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:35.463839 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-8ff0d31f-7490-442a-838b-abd20567246e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1036593956" status: 204 len: 0 microversion: 2.20 time: 0.028281 May 19 06:39:35.468342 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 411/819] 10.222.0.65 () {60 vars in 1261 bytes} [Thu May 19 06:39:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1036593956 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 19 06:39:35.496467 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a27dbd9d-11f0-48a8-b1c2-cc2e5268b1e4 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cde6f1714941f9a0a094332eae9404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887496db011b48b5a8a5f2da6d8c5e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:35.510985 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a27dbd9d-11f0-48a8-b1c2-cc2e5268b1e4 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda" status: 200 len: 1276 microversion: 2.1 time: 0.173367 May 19 06:39:35.511761 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 409/820] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:39:35 2022] GET /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda => generated 1276 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:39:36.495494 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-08d09f3a-bbe4-46e4-b2d7-3e92ccb1c8e5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Action: 'create', calling method: .version_select at 0x7f9aeac81c10>, body: {"keypair": {"name": "tempest-keypair-2040039853", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6krmeknw9wrHSLTzibMiRNBYUGnC/L/Req/Utdoy3fXo9bbMgI9890Jvdt88nOSlf8VVwC4iLwN/P4gRmELrDRrqFno56Z8JPklj+AtcPSwROXYDiTY/+Ixeuc8sPFXw=="}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:39:36.511786 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-08d09f3a-bbe4-46e4-b2d7-3e92ccb1c8e5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Getting quotas for project e21ed8d40dab40828a1fc685ca63ad92. Resources: {'key_pairs'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:39:36.516946 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-08d09f3a-bbe4-46e4-b2d7-3e92ccb1c8e5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Getting quotas for user 3a8abbf889e149f5be25ecddb22384a5 and project e21ed8d40dab40828a1fc685ca63ad92. Resources: {'key_pairs'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:39:36.528842 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-4e985673-52d8-4fff-a052-680133da85c9 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:36.530460 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-4e985673-52d8-4fff-a052-680133da85c9 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 59a72f2f-7a49-47cf-9adc-d341fb74fdda] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:36.547754 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-08d09f3a-bbe4-46e4-b2d7-3e92ccb1c8e5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.056015 May 19 06:39:36.548683 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 412/821] 10.222.0.65 () {62 vars in 1199 bytes} [Thu May 19 06:39:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 58 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 19 06:39:36.551290 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4e985673-52d8-4fff-a052-680133da85c9 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:36.551745 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4e985673-52d8-4fff-a052-680133da85c9 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:36.552517 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4e985673-52d8-4fff-a052-680133da85c9 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:36.552951 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4e985673-52d8-4fff-a052-680133da85c9 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:36.825846 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4e985673-52d8-4fff-a052-680133da85c9 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cde6f1714941f9a0a094332eae9404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887496db011b48b5a8a5f2da6d8c5e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:36.834510 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-4e985673-52d8-4fff-a052-680133da85c9 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda" status: 200 len: 1318 microversion: 2.1 time: 0.310137 May 19 06:39:36.835266 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 410/822] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:39:36 2022] GET /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:39:37.202524 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-8bef0490-e089-4f58-b0e3-d15cc5a1a0e5 req-d56cc04c-a27a-4fb3-a762-718929830691 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59a72f2f-7a49-47cf-9adc-d341fb74fdda", "tag": "126c4c64-3fdd-413e-a5cb-d7c478b281cd"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:39:37.213731 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-8bef0490-e089-4f58-b0e3-d15cc5a1a0e5 req-d56cc04c-a27a-4fb3-a762-718929830691 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:37.214457 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-8bef0490-e089-4f58-b0e3-d15cc5a1a0e5 req-d56cc04c-a27a-4fb3-a762-718929830691 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:37.235465 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-8bef0490-e089-4f58-b0e3-d15cc5a1a0e5 req-d56cc04c-a27a-4fb3-a762-718929830691 service nova] Creating event network-changed:126c4c64-3fdd-413e-a5cb-d7c478b281cd for instance 59a72f2f-7a49-47cf-9adc-d341fb74fdda on hv-cinder-83699 May 19 06:39:37.240308 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-8bef0490-e089-4f58-b0e3-d15cc5a1a0e5 req-d56cc04c-a27a-4fb3-a762-718929830691 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041484 May 19 06:39:37.240918 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 413/823] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:39:37.852168 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e68c6832-5c04-4546-9ab6-70bdd7647c46 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:37.852795 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e68c6832-5c04-4546-9ab6-70bdd7647c46 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 59a72f2f-7a49-47cf-9adc-d341fb74fdda] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:37.860522 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e68c6832-5c04-4546-9ab6-70bdd7647c46 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:37.860979 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e68c6832-5c04-4546-9ab6-70bdd7647c46 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:37.861794 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e68c6832-5c04-4546-9ab6-70bdd7647c46 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:37.862241 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e68c6832-5c04-4546-9ab6-70bdd7647c46 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:38.002538 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e68c6832-5c04-4546-9ab6-70bdd7647c46 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cde6f1714941f9a0a094332eae9404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887496db011b48b5a8a5f2da6d8c5e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:38.010182 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e68c6832-5c04-4546-9ab6-70bdd7647c46 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda" status: 200 len: 1318 microversion: 2.1 time: 0.161996 May 19 06:39:38.010764 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 411/824] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:39:37 2022] GET /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:39:38.242636 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ddc22fb4-a026-421c-a673-806dac4402f9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-558821125", "imageRef": "27959167-098e-44c5-ba0a-e9fb8054c377", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "57283c78-cedc-47c0-a4e8-516a188cf396"}], "security_groups": [{"name": "tempest-securitygroup--866493427"}], "key_name": "tempest-keypair-2040039853", "user_data": "}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:39:38.355698 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.network.neutron [None req-ddc22fb4-a026-421c-a673-806dac4402f9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] validate_networks() for [('57283c78-cedc-47c0-a4e8-516a188cf396', None, None, None, None, None)] {{(pid=117712) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 06:39:38.727874 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-ddc22fb4-a026-421c-a673-806dac4402f9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Flavor limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 06:39:38.728296 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-ddc22fb4-a026-421c-a673-806dac4402f9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Image limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 06:39:38.728781 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-ddc22fb4-a026-421c-a673-806dac4402f9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Flavor pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 06:39:38.729190 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-ddc22fb4-a026-421c-a673-806dac4402f9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Image pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 06:39:38.729628 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-ddc22fb4-a026-421c-a673-806dac4402f9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 06:39:38.739324 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ddc22fb4-a026-421c-a673-806dac4402f9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:38.739771 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ddc22fb4-a026-421c-a673-806dac4402f9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:38.740564 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ddc22fb4-a026-421c-a673-806dac4402f9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:38.740996 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ddc22fb4-a026-421c-a673-806dac4402f9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:38.757725 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-ddc22fb4-a026-421c-a673-806dac4402f9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Getting quotas for project e21ed8d40dab40828a1fc685ca63ad92. Resources: {'ram', 'cores', 'instances'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:39:38.761740 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-ddc22fb4-a026-421c-a673-806dac4402f9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Getting quotas for user 3a8abbf889e149f5be25ecddb22384a5 and project e21ed8d40dab40828a1fc685ca63ad92. Resources: {'ram', 'cores', 'instances'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:39:38.773616 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ddc22fb4-a026-421c-a673-806dac4402f9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Going to run 1 instances... {{(pid=117712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 06:39:38.776080 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ddc22fb4-a026-421c-a673-806dac4402f9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27959167-098e-44c5-ba0a-e9fb8054c377',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 06:39:38.826113 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ddc22fb4-a026-421c-a673-806dac4402f9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.588584 May 19 06:39:38.826759 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 414/825] 10.222.0.65 () {62 vars in 1187 bytes} [Thu May 19 06:39:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 06:39:38.837503 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-34e357d4-fcbe-463e-aa34-39765513ed92 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:38.838115 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-34e357d4-fcbe-463e-aa34-39765513ed92 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:38.891938 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-34e357d4-fcbe-463e-aa34-39765513ed92 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:38.899144 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-34e357d4-fcbe-463e-aa34-39765513ed92 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:38.900926 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-34e357d4-fcbe-463e-aa34-39765513ed92 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:38.902057 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-34e357d4-fcbe-463e-aa34-39765513ed92 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1281 microversion: 2.20 time: 0.068432 May 19 06:39:38.902601 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 412/826] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:39:38 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:39:39.028021 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2e441f21-778a-4eff-8cbb-0c2c855d9266 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:39.028713 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-2e441f21-778a-4eff-8cbb-0c2c855d9266 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 59a72f2f-7a49-47cf-9adc-d341fb74fdda] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:39.041550 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2e441f21-778a-4eff-8cbb-0c2c855d9266 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:39.042085 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2e441f21-778a-4eff-8cbb-0c2c855d9266 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:39.043075 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2e441f21-778a-4eff-8cbb-0c2c855d9266 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:39.043414 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2e441f21-778a-4eff-8cbb-0c2c855d9266 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:39.196333 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-2e441f21-778a-4eff-8cbb-0c2c855d9266 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cde6f1714941f9a0a094332eae9404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887496db011b48b5a8a5f2da6d8c5e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:39.205674 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2e441f21-778a-4eff-8cbb-0c2c855d9266 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda" status: 200 len: 1318 microversion: 2.1 time: 0.181362 May 19 06:39:39.206646 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 415/827] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:39:39 2022] GET /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:39:39.920821 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ff6c3dae-b32b-4122-b746-1d8223e43a8f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:39.922186 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ff6c3dae-b32b-4122-b746-1d8223e43a8f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:39.929512 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ff6c3dae-b32b-4122-b746-1d8223e43a8f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:39.929955 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ff6c3dae-b32b-4122-b746-1d8223e43a8f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:39.930712 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ff6c3dae-b32b-4122-b746-1d8223e43a8f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:39.931142 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ff6c3dae-b32b-4122-b746-1d8223e43a8f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:39.993614 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ff6c3dae-b32b-4122-b746-1d8223e43a8f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:40.002310 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ff6c3dae-b32b-4122-b746-1d8223e43a8f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:40.003829 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ff6c3dae-b32b-4122-b746-1d8223e43a8f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:40.005088 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ff6c3dae-b32b-4122-b746-1d8223e43a8f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1333 microversion: 2.20 time: 0.088212 May 19 06:39:40.005700 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 413/828] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:39:39 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1333 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:39:40.223087 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-db315b35-8974-4361-978c-f0ae1b793708 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:40.223744 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-db315b35-8974-4361-978c-f0ae1b793708 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 59a72f2f-7a49-47cf-9adc-d341fb74fdda] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:40.230221 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-db315b35-8974-4361-978c-f0ae1b793708 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:40.230671 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-db315b35-8974-4361-978c-f0ae1b793708 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:40.231428 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-db315b35-8974-4361-978c-f0ae1b793708 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:40.231860 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-db315b35-8974-4361-978c-f0ae1b793708 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:40.386065 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-db315b35-8974-4361-978c-f0ae1b793708 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cde6f1714941f9a0a094332eae9404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887496db011b48b5a8a5f2da6d8c5e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:40.394731 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-db315b35-8974-4361-978c-f0ae1b793708 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda" status: 200 len: 1318 microversion: 2.1 time: 0.175343 May 19 06:39:40.395308 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 416/829] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:39:40 2022] GET /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:39:41.025139 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-97dfd43e-e7a3-428e-92ef-2a1f0d5cc13f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:41.026434 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-97dfd43e-e7a3-428e-92ef-2a1f0d5cc13f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:41.033335 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-97dfd43e-e7a3-428e-92ef-2a1f0d5cc13f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:41.034004 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-97dfd43e-e7a3-428e-92ef-2a1f0d5cc13f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:41.034995 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-97dfd43e-e7a3-428e-92ef-2a1f0d5cc13f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:41.035602 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-97dfd43e-e7a3-428e-92ef-2a1f0d5cc13f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:41.231493 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-b7959310-5d0a-467d-b402-abd02781708f req-d809896a-bdcc-4fbb-b8e5-ca4aef2a76aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a72f2f-7a49-47cf-9adc-d341fb74fdda", "name": "network-vif-plugged", "status": "completed", "tag": "126c4c64-3fdd-413e-a5cb-d7c478b281cd"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:39:41.241514 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-b7959310-5d0a-467d-b402-abd02781708f req-d809896a-bdcc-4fbb-b8e5-ca4aef2a76aa service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:41.241969 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-b7959310-5d0a-467d-b402-abd02781708f req-d809896a-bdcc-4fbb-b8e5-ca4aef2a76aa service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:41.255557 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-b7959310-5d0a-467d-b402-abd02781708f req-d809896a-bdcc-4fbb-b8e5-ca4aef2a76aa service nova] Creating event network-vif-plugged:126c4c64-3fdd-413e-a5cb-d7c478b281cd for instance 59a72f2f-7a49-47cf-9adc-d341fb74fdda on hv-cinder-83699 May 19 06:39:41.261539 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-b7959310-5d0a-467d-b402-abd02781708f req-d809896a-bdcc-4fbb-b8e5-ca4aef2a76aa service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033902 May 19 06:39:41.262146 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 417/830] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:39:41.412858 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ce57d458-7fc7-4d37-9b43-362ee44b6135 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:41.413465 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-97dfd43e-e7a3-428e-92ef-2a1f0d5cc13f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:41.414227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ce57d458-7fc7-4d37-9b43-362ee44b6135 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 59a72f2f-7a49-47cf-9adc-d341fb74fdda] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:41.421768 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ce57d458-7fc7-4d37-9b43-362ee44b6135 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:41.422542 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ce57d458-7fc7-4d37-9b43-362ee44b6135 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:41.423865 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ce57d458-7fc7-4d37-9b43-362ee44b6135 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:41.424126 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-97dfd43e-e7a3-428e-92ef-2a1f0d5cc13f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:41.424968 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ce57d458-7fc7-4d37-9b43-362ee44b6135 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:41.425865 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-97dfd43e-e7a3-428e-92ef-2a1f0d5cc13f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:41.427150 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-97dfd43e-e7a3-428e-92ef-2a1f0d5cc13f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1406 microversion: 2.20 time: 0.406035 May 19 06:39:41.428085 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 414/831] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:39:41 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1406 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:39:41.592395 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ce57d458-7fc7-4d37-9b43-362ee44b6135 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cde6f1714941f9a0a094332eae9404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887496db011b48b5a8a5f2da6d8c5e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:41.600896 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ce57d458-7fc7-4d37-9b43-362ee44b6135 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda" status: 200 len: 1318 microversion: 2.1 time: 0.192509 May 19 06:39:41.601621 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 418/832] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:39:41 2022] GET /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:39:42.139964 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-feed03b5-7036-48f5-b0be-63488ca41132 req-9c067ce5-a6ac-43dd-bb0e-6283de853e45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbdc43c2-f91a-4d38-ba69-9ca674473c29", "tag": "57cf34a9-09b7-4eef-bf62-a47e8faa3f32"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:39:42.150905 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-feed03b5-7036-48f5-b0be-63488ca41132 req-9c067ce5-a6ac-43dd-bb0e-6283de853e45 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:42.151360 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-feed03b5-7036-48f5-b0be-63488ca41132 req-9c067ce5-a6ac-43dd-bb0e-6283de853e45 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:42.164988 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-feed03b5-7036-48f5-b0be-63488ca41132 req-9c067ce5-a6ac-43dd-bb0e-6283de853e45 service nova] Creating event network-changed:57cf34a9-09b7-4eef-bf62-a47e8faa3f32 for instance cbdc43c2-f91a-4d38-ba69-9ca674473c29 on hv-cinder-83699 May 19 06:39:42.170440 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-feed03b5-7036-48f5-b0be-63488ca41132 req-9c067ce5-a6ac-43dd-bb0e-6283de853e45 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034151 May 19 06:39:42.171051 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 415/833] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:39:42.447101 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7dc0a79b-fbc2-4227-89e3-4336c3126756 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:42.447827 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7dc0a79b-fbc2-4227-89e3-4336c3126756 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:42.454936 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7dc0a79b-fbc2-4227-89e3-4336c3126756 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:42.455490 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7dc0a79b-fbc2-4227-89e3-4336c3126756 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:42.456326 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7dc0a79b-fbc2-4227-89e3-4336c3126756 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:42.456832 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7dc0a79b-fbc2-4227-89e3-4336c3126756 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:42.593953 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7dc0a79b-fbc2-4227-89e3-4336c3126756 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:42.597501 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:39:42.602548 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7dc0a79b-fbc2-4227-89e3-4336c3126756 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:42.604045 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7dc0a79b-fbc2-4227-89e3-4336c3126756 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:42.605143 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7dc0a79b-fbc2-4227-89e3-4336c3126756 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1406 microversion: 2.20 time: 0.162126 May 19 06:39:42.605730 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 419/834] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:39:42 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:39:42.618789 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0d1ef075-285e-45c7-97fc-993a576520b0 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:42.619480 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0d1ef075-285e-45c7-97fc-993a576520b0 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 59a72f2f-7a49-47cf-9adc-d341fb74fdda] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:42.626215 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0d1ef075-285e-45c7-97fc-993a576520b0 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:42.626654 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0d1ef075-285e-45c7-97fc-993a576520b0 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:42.627402 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0d1ef075-285e-45c7-97fc-993a576520b0 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:42.627825 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0d1ef075-285e-45c7-97fc-993a576520b0 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:42.762508 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0d1ef075-285e-45c7-97fc-993a576520b0 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cde6f1714941f9a0a094332eae9404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887496db011b48b5a8a5f2da6d8c5e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:42.769961 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0d1ef075-285e-45c7-97fc-993a576520b0 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda" status: 200 len: 1318 microversion: 2.1 time: 0.155459 May 19 06:39:42.770519 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 416/835] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:39:42 2022] GET /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:39:43.623559 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-5c5effe4-9048-458d-90e0-f0d115759120 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:43.624192 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-5c5effe4-9048-458d-90e0-f0d115759120 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:43.627941 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:39:43.632512 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5c5effe4-9048-458d-90e0-f0d115759120 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:43.632962 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5c5effe4-9048-458d-90e0-f0d115759120 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:43.633780 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5c5effe4-9048-458d-90e0-f0d115759120 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:43.634215 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5c5effe4-9048-458d-90e0-f0d115759120 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:43.785975 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-5c5effe4-9048-458d-90e0-f0d115759120 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:43.786737 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-880384ad-68df-4edd-a5b0-b16feed0382e tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:43.787416 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-880384ad-68df-4edd-a5b0-b16feed0382e tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 59a72f2f-7a49-47cf-9adc-d341fb74fdda] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:43.794109 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-880384ad-68df-4edd-a5b0-b16feed0382e tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:43.794463 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-5c5effe4-9048-458d-90e0-f0d115759120 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:43.794596 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-880384ad-68df-4edd-a5b0-b16feed0382e tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:43.795315 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-880384ad-68df-4edd-a5b0-b16feed0382e tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:43.795747 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-880384ad-68df-4edd-a5b0-b16feed0382e tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:43.795972 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-5c5effe4-9048-458d-90e0-f0d115759120 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:43.797857 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-5c5effe4-9048-458d-90e0-f0d115759120 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1406 microversion: 2.20 time: 0.178558 May 19 06:39:43.798578 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 420/836] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:39:43 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:39:43.925052 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-880384ad-68df-4edd-a5b0-b16feed0382e tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cde6f1714941f9a0a094332eae9404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887496db011b48b5a8a5f2da6d8c5e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:43.932533 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-880384ad-68df-4edd-a5b0-b16feed0382e tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda" status: 200 len: 1506 microversion: 2.1 time: 0.149628 May 19 06:39:43.933097 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 417/837] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:39:43 2022] GET /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:39:43.949761 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2a85d175-920c-46ca-9e40-64af156be811 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7374163c-3fa7-4f48-9c1c-059060ca611a", "device": "/dev/sdb"}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:39:43.950847 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-2a85d175-920c-46ca-9e40-64af156be811 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 59a72f2f-7a49-47cf-9adc-d341fb74fdda] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:43.957557 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2a85d175-920c-46ca-9e40-64af156be811 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:43.958026 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2a85d175-920c-46ca-9e40-64af156be811 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:43.958770 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2a85d175-920c-46ca-9e40-64af156be811 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:43.959194 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2a85d175-920c-46ca-9e40-64af156be811 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:44.486912 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2a85d175-920c-46ca-9e40-64af156be811 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "POST /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.540866 May 19 06:39:44.487588 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 421/838] 10.222.0.65 () {60 vars in 1322 bytes} [Thu May 19 06:39:43 2022] POST /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda/os-volume_attachments => generated 194 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:39:44.816764 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-46952048-c47a-474d-8752-483f45aec0d9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:44.817397 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-46952048-c47a-474d-8752-483f45aec0d9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:44.824271 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-46952048-c47a-474d-8752-483f45aec0d9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:44.824726 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-46952048-c47a-474d-8752-483f45aec0d9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:44.825538 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-46952048-c47a-474d-8752-483f45aec0d9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:44.826040 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-46952048-c47a-474d-8752-483f45aec0d9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:44.830779 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:39:44.970754 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-46952048-c47a-474d-8752-483f45aec0d9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:44.979288 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-46952048-c47a-474d-8752-483f45aec0d9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:44.980833 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-46952048-c47a-474d-8752-483f45aec0d9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:44.982045 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-46952048-c47a-474d-8752-483f45aec0d9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1406 microversion: 2.20 time: 0.170175 May 19 06:39:44.982618 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 418/839] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:39:44 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:39:46.011272 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-14e4b88d-b55e-4cf2-a99d-af576623c7be tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:46.011984 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-14e4b88d-b55e-4cf2-a99d-af576623c7be tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:46.019576 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-14e4b88d-b55e-4cf2-a99d-af576623c7be tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:46.020029 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-14e4b88d-b55e-4cf2-a99d-af576623c7be tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:46.020816 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-14e4b88d-b55e-4cf2-a99d-af576623c7be tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:46.021253 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-14e4b88d-b55e-4cf2-a99d-af576623c7be tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:46.158291 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-14e4b88d-b55e-4cf2-a99d-af576623c7be tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:46.166626 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-14e4b88d-b55e-4cf2-a99d-af576623c7be tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:46.168201 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-14e4b88d-b55e-4cf2-a99d-af576623c7be tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:46.169367 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-14e4b88d-b55e-4cf2-a99d-af576623c7be tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1406 microversion: 2.20 time: 0.163305 May 19 06:39:46.169934 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 422/840] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:39:46 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:39:47.187839 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-def212a7-4d2f-440e-9d4c-fa0881249ca1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:47.188675 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-def212a7-4d2f-440e-9d4c-fa0881249ca1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:47.196375 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-def212a7-4d2f-440e-9d4c-fa0881249ca1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:47.196928 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-def212a7-4d2f-440e-9d4c-fa0881249ca1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:47.198039 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-def212a7-4d2f-440e-9d4c-fa0881249ca1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:47.198688 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-def212a7-4d2f-440e-9d4c-fa0881249ca1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:47.295932 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-4c25d8d7-1a23-4d38-a467-306ddb74e7aa req-c6caf0be-e979-4c91-9d6b-48cb6aad0da4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbdc43c2-f91a-4d38-ba69-9ca674473c29", "name": "network-vif-plugged", "status": "completed", "tag": "57cf34a9-09b7-4eef-bf62-a47e8faa3f32"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:39:47.310541 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-4c25d8d7-1a23-4d38-a467-306ddb74e7aa req-c6caf0be-e979-4c91-9d6b-48cb6aad0da4 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:47.310994 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-4c25d8d7-1a23-4d38-a467-306ddb74e7aa req-c6caf0be-e979-4c91-9d6b-48cb6aad0da4 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:47.330652 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-4c25d8d7-1a23-4d38-a467-306ddb74e7aa req-c6caf0be-e979-4c91-9d6b-48cb6aad0da4 service nova] Creating event network-vif-plugged:57cf34a9-09b7-4eef-bf62-a47e8faa3f32 for instance cbdc43c2-f91a-4d38-ba69-9ca674473c29 on hv-cinder-83699 May 19 06:39:47.337846 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-4c25d8d7-1a23-4d38-a467-306ddb74e7aa req-c6caf0be-e979-4c91-9d6b-48cb6aad0da4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048707 May 19 06:39:47.339046 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 423/841] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:39:47.358430 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-def212a7-4d2f-440e-9d4c-fa0881249ca1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:47.368684 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-def212a7-4d2f-440e-9d4c-fa0881249ca1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:47.370363 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-def212a7-4d2f-440e-9d4c-fa0881249ca1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:47.371760 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-def212a7-4d2f-440e-9d4c-fa0881249ca1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1406 microversion: 2.20 time: 0.187968 May 19 06:39:47.372521 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 419/842] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:39:47 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:39:48.391338 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-daa63186-ab4e-4be2-8f24-cc9e511a2bf1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:48.392035 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-daa63186-ab4e-4be2-8f24-cc9e511a2bf1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:48.399022 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-daa63186-ab4e-4be2-8f24-cc9e511a2bf1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:48.399794 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-daa63186-ab4e-4be2-8f24-cc9e511a2bf1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:48.401003 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-daa63186-ab4e-4be2-8f24-cc9e511a2bf1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:48.401732 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-daa63186-ab4e-4be2-8f24-cc9e511a2bf1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:48.545565 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-daa63186-ab4e-4be2-8f24-cc9e511a2bf1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:48.553936 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-daa63186-ab4e-4be2-8f24-cc9e511a2bf1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:48.555428 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-daa63186-ab4e-4be2-8f24-cc9e511a2bf1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:48.556521 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-daa63186-ab4e-4be2-8f24-cc9e511a2bf1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1406 microversion: 2.20 time: 0.170251 May 19 06:39:48.557082 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 424/843] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:39:48 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:39:49.574629 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c88a9522-4e7b-4d5c-944c-86c0855e74f8 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:49.575174 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c88a9522-4e7b-4d5c-944c-86c0855e74f8 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:49.578233 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:39:49.583734 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c88a9522-4e7b-4d5c-944c-86c0855e74f8 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:49.584179 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c88a9522-4e7b-4d5c-944c-86c0855e74f8 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:49.584940 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c88a9522-4e7b-4d5c-944c-86c0855e74f8 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:49.585398 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c88a9522-4e7b-4d5c-944c-86c0855e74f8 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:49.885026 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c88a9522-4e7b-4d5c-944c-86c0855e74f8 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:49.893457 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c88a9522-4e7b-4d5c-944c-86c0855e74f8 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:49.894945 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c88a9522-4e7b-4d5c-944c-86c0855e74f8 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:39:49.896083 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c88a9522-4e7b-4d5c-944c-86c0855e74f8 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1598 microversion: 2.20 time: 0.325472 May 19 06:39:49.896621 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 420/844] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:39:49 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1598 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:39:49.913476 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9af5e991-561c-4fe1-a874-fd74924e6638 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:39:49.913980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9af5e991-561c-4fe1-a874-fd74924e6638 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:39:49.915868 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=4 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:39:49.916517 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=18 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:39:49.922993 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9af5e991-561c-4fe1-a874-fd74924e6638 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:49.923434 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9af5e991-561c-4fe1-a874-fd74924e6638 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:49.924185 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9af5e991-561c-4fe1-a874-fd74924e6638 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:49.924614 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9af5e991-561c-4fe1-a874-fd74924e6638 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:50.009718 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9af5e991-561c-4fe1-a874-fd74924e6638 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.100086 May 19 06:39:50.010350 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 425/845] 10.222.0.65 () {60 vars in 1315 bytes} [Thu May 19 06:39:49 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 06:39:51.007357 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-7c7441ee-d8e1-413e-b3e1-31ceb1673835 req-f9334f2c-6bc1-4c85-8902-90cb0cbd052f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbdc43c2-f91a-4d38-ba69-9ca674473c29", "tag": "57cf34a9-09b7-4eef-bf62-a47e8faa3f32"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:39:51.012652 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=45 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:39:51.017324 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-7c7441ee-d8e1-413e-b3e1-31ceb1673835 req-f9334f2c-6bc1-4c85-8902-90cb0cbd052f service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:39:51.017973 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-7c7441ee-d8e1-413e-b3e1-31ceb1673835 req-f9334f2c-6bc1-4c85-8902-90cb0cbd052f service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:39:51.029996 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-7c7441ee-d8e1-413e-b3e1-31ceb1673835 req-f9334f2c-6bc1-4c85-8902-90cb0cbd052f service nova] Creating event network-changed:57cf34a9-09b7-4eef-bf62-a47e8faa3f32 for instance cbdc43c2-f91a-4d38-ba69-9ca674473c29 on hv-cinder-83699 May 19 06:39:51.036339 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-7c7441ee-d8e1-413e-b3e1-31ceb1673835 req-f9334f2c-6bc1-4c85-8902-90cb0cbd052f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032541 May 19 06:39:51.037041 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 421/846] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:40:01.940197 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=10 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:40:01.941135 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:40:01.945622 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-30dd4255-d3b0-4f02-b59c-894d71a7c1b6 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:01.946116 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-30dd4255-d3b0-4f02-b59c-894d71a7c1b6 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 59a72f2f-7a49-47cf-9adc-d341fb74fdda] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:01.953592 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-30dd4255-d3b0-4f02-b59c-894d71a7c1b6 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:01.954041 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-30dd4255-d3b0-4f02-b59c-894d71a7c1b6 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:01.954807 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-30dd4255-d3b0-4f02-b59c-894d71a7c1b6 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:01.955241 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-30dd4255-d3b0-4f02-b59c-894d71a7c1b6 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:02.036141 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-30dd4255-d3b0-4f02-b59c-894d71a7c1b6 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lazy-loading 'services' on Instance uuid 59a72f2f-7a49-47cf-9adc-d341fb74fdda {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:40:02.112429 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-30dd4255-d3b0-4f02-b59c-894d71a7c1b6 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "DELETE /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda/os-volume_attachments/7374163c-3fa7-4f48-9c1c-059060ca611a" status: 202 len: 0 microversion: 2.1 time: 0.172255 May 19 06:40:02.113517 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 426/847] 10.222.0.65 () {58 vars in 1415 bytes} [Thu May 19 06:40:01 2022] DELETE /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda/os-volume_attachments/7374163c-3fa7-4f48-9c1c-059060ca611a => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 06:40:03.226594 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=18 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:40:03.227327 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:40:03.231726 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0ba91307-f08b-4428-bdbc-eabffa475ebd tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:03.232308 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0ba91307-f08b-4428-bdbc-eabffa475ebd tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 59a72f2f-7a49-47cf-9adc-d341fb74fdda] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:03.239872 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0ba91307-f08b-4428-bdbc-eabffa475ebd tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:03.240319 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0ba91307-f08b-4428-bdbc-eabffa475ebd tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:03.241078 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0ba91307-f08b-4428-bdbc-eabffa475ebd tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:03.241536 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0ba91307-f08b-4428-bdbc-eabffa475ebd tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:03.265530 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0ba91307-f08b-4428-bdbc-eabffa475ebd tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 59a72f2f-7a49-47cf-9adc-d341fb74fdda] Going to try to terminate instance {{(pid=117711) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 06:40:03.356591 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0ba91307-f08b-4428-bdbc-eabffa475ebd tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "DELETE /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda" status: 204 len: 0 microversion: 2.1 time: 0.131074 May 19 06:40:03.357197 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 422/848] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 06:40:03 2022] DELETE /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 06:40:03.367416 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c985e1b6-eae2-4ccb-9409-03f9b26748cc tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:03.368115 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c985e1b6-eae2-4ccb-9409-03f9b26748cc tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 59a72f2f-7a49-47cf-9adc-d341fb74fdda] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:03.374819 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c985e1b6-eae2-4ccb-9409-03f9b26748cc tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:03.375258 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c985e1b6-eae2-4ccb-9409-03f9b26748cc tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:03.376003 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c985e1b6-eae2-4ccb-9409-03f9b26748cc tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:03.376429 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c985e1b6-eae2-4ccb-9409-03f9b26748cc tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:03.514743 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c985e1b6-eae2-4ccb-9409-03f9b26748cc tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cde6f1714941f9a0a094332eae9404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887496db011b48b5a8a5f2da6d8c5e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:03.522927 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c985e1b6-eae2-4ccb-9409-03f9b26748cc tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda" status: 200 len: 1512 microversion: 2.1 time: 0.159823 May 19 06:40:03.523506 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 427/849] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:40:03 2022] GET /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:40:04.541623 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-10026409-bbb5-4b49-b435-ba51fb9aec85 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:04.542346 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-10026409-bbb5-4b49-b435-ba51fb9aec85 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 59a72f2f-7a49-47cf-9adc-d341fb74fdda] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:04.549330 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-10026409-bbb5-4b49-b435-ba51fb9aec85 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:04.549779 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-10026409-bbb5-4b49-b435-ba51fb9aec85 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:04.550538 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-10026409-bbb5-4b49-b435-ba51fb9aec85 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:04.550965 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-10026409-bbb5-4b49-b435-ba51fb9aec85 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:04.687469 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-10026409-bbb5-4b49-b435-ba51fb9aec85 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cde6f1714941f9a0a094332eae9404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887496db011b48b5a8a5f2da6d8c5e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:04.695714 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-10026409-bbb5-4b49-b435-ba51fb9aec85 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda" status: 200 len: 1512 microversion: 2.1 time: 0.158227 May 19 06:40:04.696508 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 423/850] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:40:04 2022] GET /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:40:05.519282 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-0eae2416-1b35-4b79-a350-052609866037 req-7e7b8727-9fbb-4e92-82cf-2a11b05544d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a72f2f-7a49-47cf-9adc-d341fb74fdda", "name": "network-vif-deleted", "tag": "126c4c64-3fdd-413e-a5cb-d7c478b281cd"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:40:05.535290 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-0eae2416-1b35-4b79-a350-052609866037 req-7e7b8727-9fbb-4e92-82cf-2a11b05544d8 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:05.536431 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-0eae2416-1b35-4b79-a350-052609866037 req-7e7b8727-9fbb-4e92-82cf-2a11b05544d8 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:05.555650 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-0eae2416-1b35-4b79-a350-052609866037 req-7e7b8727-9fbb-4e92-82cf-2a11b05544d8 service nova] Creating event network-vif-deleted:126c4c64-3fdd-413e-a5cb-d7c478b281cd for instance 59a72f2f-7a49-47cf-9adc-d341fb74fdda on hv-cinder-83699 May 19 06:40:05.565058 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-0eae2416-1b35-4b79-a350-052609866037 req-7e7b8727-9fbb-4e92-82cf-2a11b05544d8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053458 May 19 06:40:05.566768 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 428/851] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:40:05.713681 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-233b2525-3517-41e6-a2f2-f62b68c7f707 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:05.714344 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-233b2525-3517-41e6-a2f2-f62b68c7f707 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 59a72f2f-7a49-47cf-9adc-d341fb74fdda] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:05.721890 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-233b2525-3517-41e6-a2f2-f62b68c7f707 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:05.722340 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-233b2525-3517-41e6-a2f2-f62b68c7f707 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:05.723122 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-233b2525-3517-41e6-a2f2-f62b68c7f707 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:05.723556 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-233b2525-3517-41e6-a2f2-f62b68c7f707 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:05.754968 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-233b2525-3517-41e6-a2f2-f62b68c7f707 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:05.755413 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-233b2525-3517-41e6-a2f2-f62b68c7f707 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:05.755863 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-233b2525-3517-41e6-a2f2-f62b68c7f707 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lazy-loading 'fault' on Instance uuid 59a72f2f-7a49-47cf-9adc-d341fb74fdda {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:40:05.797200 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-233b2525-3517-41e6-a2f2-f62b68c7f707 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cde6f1714941f9a0a094332eae9404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887496db011b48b5a8a5f2da6d8c5e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:05.804706 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-233b2525-3517-41e6-a2f2-f62b68c7f707 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda" status: 200 len: 1308 microversion: 2.1 time: 0.094985 May 19 06:40:05.805332 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 424/852] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:40:05 2022] GET /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:40:06.822737 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-78903f3e-df14-48d9-ac63-5e56e3f6cca2 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:06.823430 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-78903f3e-df14-48d9-ac63-5e56e3f6cca2 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] [instance: 59a72f2f-7a49-47cf-9adc-d341fb74fdda] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:06.830063 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-78903f3e-df14-48d9-ac63-5e56e3f6cca2 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:06.830632 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-78903f3e-df14-48d9-ac63-5e56e3f6cca2 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:06.831284 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-78903f3e-df14-48d9-ac63-5e56e3f6cca2 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:06.831709 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-78903f3e-df14-48d9-ac63-5e56e3f6cca2 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:06.845007 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-78903f3e-df14-48d9-ac63-5e56e3f6cca2 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] HTTP exception thrown: Instance 59a72f2f-7a49-47cf-9adc-d341fb74fdda could not be found. May 19 06:40:06.846649 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-78903f3e-df14-48d9-ac63-5e56e3f6cca2 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Request method failure captured: May 19 06:40:06.846649 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda HTTP/1.1 May 19 06:40:06.846649 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept: application/json May 19 06:40:06.846649 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity May 19 06:40:06.846649 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Connection: close May 19 06:40:06.846649 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Length: 0 May 19 06:40:06.846649 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Type: application/json May 19 06:40:06.846649 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Host: 10.222.0.65 May 19 06:40:06.846649 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None May 19 06:40:06.846649 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 May 19 06:40:06.846649 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiheXeYFkRnwCOg4n2h7UHhPJY7b7CKJNTXB87bJwFO_b67ClCblyPZnm8XU4ycwK1OARuGtIdHYjf65V-NjDVd8U2p5t61lMYT58I56AH-uPDcXZhkzv0fZRVlVYbRD7OD79a1oa0tZ9FkxEyFSKDMyn1hoYGPL2OqXmtXbB2TQxGUTg May 19 06:40:06.846649 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Id: None May 19 06:40:06.846649 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Name: None May 19 06:40:06.846649 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed May 19 06:40:06.846649 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True May 19 06:40:06.846649 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default May 19 06:40:06.846649 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default May 19 06:40:06.846649 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Id: 887496db011b48b5a8a5f2da6d8c5e44 May 19 06:40:06.846649 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1620388866 May 19 06:40:06.846649 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Role: reader,member May 19 06:40:06.846649 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Roles: reader,member May 19 06:40:06.848360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/887496db011b48b5a8a5f2da6d8c5e44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/887496db011b48b5a8a5f2da6d8c5e44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/887496db011b48b5a8a5f2da6d8c5e44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_887496db011b48b5a8a5f2da6d8c5e44", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:40:06.848360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-VolumesSnapshotTestJSON-1620388866 May 19 06:40:06.848360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Id: 887496db011b48b5a8a5f2da6d8c5e44 May 19 06:40:06.848360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1620388866 May 19 06:40:06.848360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User: tempest-VolumesSnapshotTestJSON-1620388866-project May 19 06:40:06.848360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default May 19 06:40:06.848360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default May 19 06:40:06.848360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Id: 87cde6f1714941f9a0a094332eae9404 May 19 06:40:06.848360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-VolumesSnapshotTestJSON-1620388866-project May 19 06:40:06.848360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: method: > May 19 06:40:06.848360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: exception: Instance 59a72f2f-7a49-47cf-9adc-d341fb74fdda could not be found. May 19 06:40:06.848360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: action_args: {'id': '59a72f2f-7a49-47cf-9adc-d341fb74fdda'} May 19 06:40:06.849537 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:40:06.849537 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:40:06.849537 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:40:06.849537 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:40:06.849537 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:40:06.849537 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:40:06.849537 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:40:06.849537 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:40:06.849537 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:40:06.849537 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:40:06.849537 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59a72f2f-7a49-47cf-9adc-d341fb74fdda could not be found. May 19 06:40:06.849537 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:40:06.849537 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:40:06.849537 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:40:06.849537 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:40:06.849537 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:40:06.849537 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:40:06.849537 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:40:06.849537 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:40:06.849537 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:40:06.851211 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:40:06.851211 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:40:06.851211 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:40:06.851211 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:40:06.851211 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:40:06.851211 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:40:06.851211 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:40:06.851211 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59a72f2f-7a49-47cf-9adc-d341fb74fdda could not be found. May 19 06:40:06.851211 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:40:06.851211 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:40:06.851211 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:40:06.851211 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:40:06.851211 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:40:06.851211 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:40:06.851211 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:40:06.851211 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:40:06.851211 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59a72f2f-7a49-47cf-9adc-d341fb74fdda could not be found. May 19 06:40:06.851211 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:40:06.852899 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-78903f3e-df14-48d9-ac63-5e56e3f6cca2 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] Returning 404 to user: Instance 59a72f2f-7a49-47cf-9adc-d341fb74fdda could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:40:06.852899 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-78903f3e-df14-48d9-ac63-5e56e3f6cca2 tempest-VolumesSnapshotTestJSON-1620388866 tempest-VolumesSnapshotTestJSON-1620388866-project] 10.222.0.65 "GET /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda" status: 404 len: 111 microversion: 2.1 time: 0.029531 May 19 06:40:06.852899 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 429/853] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:40:06 2022] GET /compute/v2.1/servers/59a72f2f-7a49-47cf-9adc-d341fb74fdda => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:40:27.202669 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-77de3490-cac7-45ba-8729-ce9820d33233 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:27.203341 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-77de3490-cac7-45ba-8729-ce9820d33233 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:27.206106 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:40:27.206748 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:40:27.212494 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-77de3490-cac7-45ba-8729-ce9820d33233 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:27.212932 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-77de3490-cac7-45ba-8729-ce9820d33233 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:27.213722 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-77de3490-cac7-45ba-8729-ce9820d33233 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:27.214148 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-77de3490-cac7-45ba-8729-ce9820d33233 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:27.237138 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-77de3490-cac7-45ba-8729-ce9820d33233 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29/ips" status: 200 len: 151 microversion: 2.20 time: 0.038498 May 19 06:40:27.237736 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 425/854] 10.222.0.65 () {60 vars in 1288 bytes} [Thu May 19 06:40:27 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 06:40:29.321254 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-459ce226-db32-45b9-9bc8-a10d869daec0 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:40:29.321859 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-459ce226-db32-45b9-9bc8-a10d869daec0 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:29.324319 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=8 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:40:29.325192 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:40:29.331754 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-459ce226-db32-45b9-9bc8-a10d869daec0 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:29.332207 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-459ce226-db32-45b9-9bc8-a10d869daec0 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:29.332991 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-459ce226-db32-45b9-9bc8-a10d869daec0 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:29.333458 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-459ce226-db32-45b9-9bc8-a10d869daec0 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:29.357378 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-459ce226-db32-45b9-9bc8-a10d869daec0 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lazy-loading 'flavor' on Instance uuid cbdc43c2-f91a-4d38-ba69-9ca674473c29 {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:40:29.620325 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-459ce226-db32-45b9-9bc8-a10d869daec0 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "POST /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29/action" status: 202 len: 0 microversion: 2.20 time: 0.302809 May 19 06:40:29.621087 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 430/855] 10.222.0.65 () {62 vars in 1318 bytes} [Thu May 19 06:40:29 2022] POST /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 19 06:40:29.629377 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6a7c7919-de80-4142-ad57-61887942018e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:29.630018 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6a7c7919-de80-4142-ad57-61887942018e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:29.637202 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6a7c7919-de80-4142-ad57-61887942018e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:29.637743 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6a7c7919-de80-4142-ad57-61887942018e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:29.638512 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6a7c7919-de80-4142-ad57-61887942018e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:29.638955 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6a7c7919-de80-4142-ad57-61887942018e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:29.772962 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6a7c7919-de80-4142-ad57-61887942018e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:29.781185 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6a7c7919-de80-4142-ad57-61887942018e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:29.783581 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6a7c7919-de80-4142-ad57-61887942018e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:29.784737 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6a7c7919-de80-4142-ad57-61887942018e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1722 microversion: 2.20 time: 0.159501 May 19 06:40:29.785308 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 426/856] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:40:29 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:40:30.804617 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-55f368ad-4215-456b-a6ed-ff017519bff5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:30.805448 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-55f368ad-4215-456b-a6ed-ff017519bff5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:30.812225 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-55f368ad-4215-456b-a6ed-ff017519bff5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:30.812678 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-55f368ad-4215-456b-a6ed-ff017519bff5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:30.813483 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-55f368ad-4215-456b-a6ed-ff017519bff5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:30.813922 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-55f368ad-4215-456b-a6ed-ff017519bff5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:30.947433 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-55f368ad-4215-456b-a6ed-ff017519bff5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:30.956042 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-55f368ad-4215-456b-a6ed-ff017519bff5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:30.957742 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-55f368ad-4215-456b-a6ed-ff017519bff5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:30.958904 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-55f368ad-4215-456b-a6ed-ff017519bff5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1722 microversion: 2.20 time: 0.159121 May 19 06:40:30.959467 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 431/857] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:40:30 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:40:31.977890 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6139c64d-315b-4925-bae5-7dc7e825ca25 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:31.978469 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6139c64d-315b-4925-bae5-7dc7e825ca25 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:31.984806 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6139c64d-315b-4925-bae5-7dc7e825ca25 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:31.985249 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6139c64d-315b-4925-bae5-7dc7e825ca25 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:31.986027 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6139c64d-315b-4925-bae5-7dc7e825ca25 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:31.986456 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6139c64d-315b-4925-bae5-7dc7e825ca25 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:32.116412 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6139c64d-315b-4925-bae5-7dc7e825ca25 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:32.124154 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6139c64d-315b-4925-bae5-7dc7e825ca25 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:32.125672 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6139c64d-315b-4925-bae5-7dc7e825ca25 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:32.126798 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6139c64d-315b-4925-bae5-7dc7e825ca25 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1722 microversion: 2.20 time: 0.152924 May 19 06:40:32.127563 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 427/858] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:40:31 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:40:33.145106 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-5e32ba9b-48ac-47f1-891b-1be00d3bd7cf tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:33.145789 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-5e32ba9b-48ac-47f1-891b-1be00d3bd7cf tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:33.152587 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5e32ba9b-48ac-47f1-891b-1be00d3bd7cf tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:33.153037 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5e32ba9b-48ac-47f1-891b-1be00d3bd7cf tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:33.153832 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5e32ba9b-48ac-47f1-891b-1be00d3bd7cf tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:33.154268 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5e32ba9b-48ac-47f1-891b-1be00d3bd7cf tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:33.289881 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-5e32ba9b-48ac-47f1-891b-1be00d3bd7cf tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:33.297758 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-5e32ba9b-48ac-47f1-891b-1be00d3bd7cf tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:33.299368 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-5e32ba9b-48ac-47f1-891b-1be00d3bd7cf tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:33.301153 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-5e32ba9b-48ac-47f1-891b-1be00d3bd7cf tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1722 microversion: 2.20 time: 0.159475 May 19 06:40:33.301808 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 432/859] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:40:33 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:40:34.320263 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0166741c-0bdb-42c6-a6c3-bb7599d847c9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:34.320922 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0166741c-0bdb-42c6-a6c3-bb7599d847c9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:34.327553 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0166741c-0bdb-42c6-a6c3-bb7599d847c9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:34.328019 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0166741c-0bdb-42c6-a6c3-bb7599d847c9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:34.328822 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0166741c-0bdb-42c6-a6c3-bb7599d847c9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:34.329257 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0166741c-0bdb-42c6-a6c3-bb7599d847c9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:34.473854 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0166741c-0bdb-42c6-a6c3-bb7599d847c9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:34.481643 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0166741c-0bdb-42c6-a6c3-bb7599d847c9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:34.483131 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0166741c-0bdb-42c6-a6c3-bb7599d847c9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:34.484268 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0166741c-0bdb-42c6-a6c3-bb7599d847c9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1722 microversion: 2.20 time: 0.168717 May 19 06:40:34.484816 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 428/860] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:40:34 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:40:35.504451 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-40828ae3-c9fe-414e-b39f-a3104b16a2c6 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:35.505275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-40828ae3-c9fe-414e-b39f-a3104b16a2c6 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:35.511601 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-40828ae3-c9fe-414e-b39f-a3104b16a2c6 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:35.512049 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-40828ae3-c9fe-414e-b39f-a3104b16a2c6 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:35.512811 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-40828ae3-c9fe-414e-b39f-a3104b16a2c6 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:35.513250 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-40828ae3-c9fe-414e-b39f-a3104b16a2c6 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:35.644948 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-40828ae3-c9fe-414e-b39f-a3104b16a2c6 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:35.652819 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-40828ae3-c9fe-414e-b39f-a3104b16a2c6 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:35.654352 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-40828ae3-c9fe-414e-b39f-a3104b16a2c6 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:35.655537 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-40828ae3-c9fe-414e-b39f-a3104b16a2c6 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1722 microversion: 2.20 time: 0.155648 May 19 06:40:35.656346 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 433/861] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:40:35 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:40:36.674423 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1337af31-916a-454e-9534-2bdc36759a82 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:36.675014 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-1337af31-916a-454e-9534-2bdc36759a82 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:36.681138 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1337af31-916a-454e-9534-2bdc36759a82 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:36.681690 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1337af31-916a-454e-9534-2bdc36759a82 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:36.682447 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1337af31-916a-454e-9534-2bdc36759a82 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:36.682878 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1337af31-916a-454e-9534-2bdc36759a82 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:36.808993 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1337af31-916a-454e-9534-2bdc36759a82 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:36.818647 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1337af31-916a-454e-9534-2bdc36759a82 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:36.820138 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1337af31-916a-454e-9534-2bdc36759a82 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:36.821273 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-1337af31-916a-454e-9534-2bdc36759a82 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1722 microversion: 2.20 time: 0.150943 May 19 06:40:36.821851 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 429/862] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:40:36 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:40:37.839771 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-820a9bed-a073-49f1-b7ad-fd84f187e953 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:37.840379 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-820a9bed-a073-49f1-b7ad-fd84f187e953 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:37.846909 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-820a9bed-a073-49f1-b7ad-fd84f187e953 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:37.847901 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-820a9bed-a073-49f1-b7ad-fd84f187e953 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:37.848758 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-820a9bed-a073-49f1-b7ad-fd84f187e953 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:37.849189 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-820a9bed-a073-49f1-b7ad-fd84f187e953 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:38.186399 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-820a9bed-a073-49f1-b7ad-fd84f187e953 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:38.194456 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-820a9bed-a073-49f1-b7ad-fd84f187e953 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:38.196004 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-820a9bed-a073-49f1-b7ad-fd84f187e953 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:38.197103 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-820a9bed-a073-49f1-b7ad-fd84f187e953 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1722 microversion: 2.20 time: 0.361284 May 19 06:40:38.197690 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 434/863] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:40:37 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1722 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 06:40:39.218699 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-2833c27d-a610-4e53-b449-973401e06135 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:39.219734 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-2833c27d-a610-4e53-b449-973401e06135 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:39.229502 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2833c27d-a610-4e53-b449-973401e06135 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:39.229951 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2833c27d-a610-4e53-b449-973401e06135 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:39.230713 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2833c27d-a610-4e53-b449-973401e06135 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:39.231148 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2833c27d-a610-4e53-b449-973401e06135 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:39.412025 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2833c27d-a610-4e53-b449-973401e06135 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:39.419879 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2833c27d-a610-4e53-b449-973401e06135 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:39.421398 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2833c27d-a610-4e53-b449-973401e06135 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:39.422540 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-2833c27d-a610-4e53-b449-973401e06135 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1722 microversion: 2.20 time: 0.210688 May 19 06:40:39.423125 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 430/864] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:40:39 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:40:40.441947 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d84e30fd-85f9-43a3-9b30-0af7e8ea5b4e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:40.442604 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d84e30fd-85f9-43a3-9b30-0af7e8ea5b4e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:40.449197 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d84e30fd-85f9-43a3-9b30-0af7e8ea5b4e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:40.449733 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d84e30fd-85f9-43a3-9b30-0af7e8ea5b4e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:40.450513 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d84e30fd-85f9-43a3-9b30-0af7e8ea5b4e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:40.450945 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d84e30fd-85f9-43a3-9b30-0af7e8ea5b4e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:40.582921 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d84e30fd-85f9-43a3-9b30-0af7e8ea5b4e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:40.591051 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d84e30fd-85f9-43a3-9b30-0af7e8ea5b4e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:40.592560 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d84e30fd-85f9-43a3-9b30-0af7e8ea5b4e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:40.593754 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d84e30fd-85f9-43a3-9b30-0af7e8ea5b4e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1743 microversion: 2.20 time: 0.156520 May 19 06:40:40.594312 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 435/865] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:40:40 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:40:41.089175 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 06:40:41.089774 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Thu May 19 06:40:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 06:40:41.612187 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7ccff725-1a3d-4e4f-acef-bac28219bc9f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:41.612789 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7ccff725-1a3d-4e4f-acef-bac28219bc9f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:41.620097 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7ccff725-1a3d-4e4f-acef-bac28219bc9f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:41.620618 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7ccff725-1a3d-4e4f-acef-bac28219bc9f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:41.621410 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7ccff725-1a3d-4e4f-acef-bac28219bc9f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:41.621821 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7ccff725-1a3d-4e4f-acef-bac28219bc9f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:41.759728 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7ccff725-1a3d-4e4f-acef-bac28219bc9f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:41.767746 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7ccff725-1a3d-4e4f-acef-bac28219bc9f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:41.769330 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7ccff725-1a3d-4e4f-acef-bac28219bc9f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:41.770546 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7ccff725-1a3d-4e4f-acef-bac28219bc9f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1743 microversion: 2.20 time: 0.162324 May 19 06:40:41.771113 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 431/866] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:40:41 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:40:42.789614 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-81d2ffd0-b998-4cdf-ab0f-037a35fdfdc1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:42.790956 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-81d2ffd0-b998-4cdf-ab0f-037a35fdfdc1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:42.798481 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-81d2ffd0-b998-4cdf-ab0f-037a35fdfdc1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:42.799335 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-81d2ffd0-b998-4cdf-ab0f-037a35fdfdc1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:42.800275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-81d2ffd0-b998-4cdf-ab0f-037a35fdfdc1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:42.801024 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-81d2ffd0-b998-4cdf-ab0f-037a35fdfdc1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:42.942544 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-81d2ffd0-b998-4cdf-ab0f-037a35fdfdc1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:42.951616 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-81d2ffd0-b998-4cdf-ab0f-037a35fdfdc1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:42.953141 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-81d2ffd0-b998-4cdf-ab0f-037a35fdfdc1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:42.954364 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-81d2ffd0-b998-4cdf-ab0f-037a35fdfdc1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1738 microversion: 2.20 time: 0.168989 May 19 06:40:42.965751 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 436/867] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:40:42 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:40:43.595777 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-82b72500-1eec-4a00-91f3-240e1d319e88 req-26f19731-940e-4eb2-8079-f2bf31995d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbdc43c2-f91a-4d38-ba69-9ca674473c29", "name": "network-vif-plugged", "status": "completed", "tag": "57cf34a9-09b7-4eef-bf62-a47e8faa3f32"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:40:43.606006 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-82b72500-1eec-4a00-91f3-240e1d319e88 req-26f19731-940e-4eb2-8079-f2bf31995d03 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:43.606823 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-82b72500-1eec-4a00-91f3-240e1d319e88 req-26f19731-940e-4eb2-8079-f2bf31995d03 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:43.620394 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-82b72500-1eec-4a00-91f3-240e1d319e88 req-26f19731-940e-4eb2-8079-f2bf31995d03 service nova] Creating event network-vif-plugged:57cf34a9-09b7-4eef-bf62-a47e8faa3f32 for instance cbdc43c2-f91a-4d38-ba69-9ca674473c29 on hv-cinder-83699 May 19 06:40:43.626038 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-82b72500-1eec-4a00-91f3-240e1d319e88 req-26f19731-940e-4eb2-8079-f2bf31995d03 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034348 May 19 06:40:43.626963 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 432/868] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:40:43.973357 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4e6a527d-e6ac-4374-bed2-f9c06508fa08 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:43.973976 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4e6a527d-e6ac-4374-bed2-f9c06508fa08 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:43.980663 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4e6a527d-e6ac-4374-bed2-f9c06508fa08 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:43.981217 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4e6a527d-e6ac-4374-bed2-f9c06508fa08 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:43.982135 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4e6a527d-e6ac-4374-bed2-f9c06508fa08 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:43.982677 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4e6a527d-e6ac-4374-bed2-f9c06508fa08 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:44.130087 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-4e6a527d-e6ac-4374-bed2-f9c06508fa08 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:44.139319 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-4e6a527d-e6ac-4374-bed2-f9c06508fa08 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:44.141110 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-4e6a527d-e6ac-4374-bed2-f9c06508fa08 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:44.142300 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4e6a527d-e6ac-4374-bed2-f9c06508fa08 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1738 microversion: 2.20 time: 0.173215 May 19 06:40:44.143329 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 437/869] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:40:43 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:40:45.164393 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-66019b7f-c7e1-43bb-be10-543c7746ef6e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:45.166397 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-66019b7f-c7e1-43bb-be10-543c7746ef6e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:45.173856 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-66019b7f-c7e1-43bb-be10-543c7746ef6e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:45.174718 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-66019b7f-c7e1-43bb-be10-543c7746ef6e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:45.175889 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-66019b7f-c7e1-43bb-be10-543c7746ef6e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:45.176720 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-66019b7f-c7e1-43bb-be10-543c7746ef6e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:45.346967 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-66019b7f-c7e1-43bb-be10-543c7746ef6e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:45.356006 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-66019b7f-c7e1-43bb-be10-543c7746ef6e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:45.357937 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-66019b7f-c7e1-43bb-be10-543c7746ef6e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:45.359335 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-66019b7f-c7e1-43bb-be10-543c7746ef6e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1738 microversion: 2.20 time: 0.199928 May 19 06:40:45.360425 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 433/870] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:40:45 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:40:46.379340 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b69e614f-156a-48fe-9043-9d5a66d882e1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:46.380738 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b69e614f-156a-48fe-9043-9d5a66d882e1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:46.387658 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b69e614f-156a-48fe-9043-9d5a66d882e1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:46.388203 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b69e614f-156a-48fe-9043-9d5a66d882e1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:46.389065 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b69e614f-156a-48fe-9043-9d5a66d882e1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:46.389588 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b69e614f-156a-48fe-9043-9d5a66d882e1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:46.537203 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b69e614f-156a-48fe-9043-9d5a66d882e1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:46.546928 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b69e614f-156a-48fe-9043-9d5a66d882e1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:46.548479 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b69e614f-156a-48fe-9043-9d5a66d882e1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:46.549689 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b69e614f-156a-48fe-9043-9d5a66d882e1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1738 microversion: 2.20 time: 0.174304 May 19 06:40:46.550642 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 438/871] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:40:46 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:40:47.568213 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-4ccc54ea-c44a-4def-b3b7-b9cca04f16f3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:47.568861 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-4ccc54ea-c44a-4def-b3b7-b9cca04f16f3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:47.576177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4ccc54ea-c44a-4def-b3b7-b9cca04f16f3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:47.576623 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4ccc54ea-c44a-4def-b3b7-b9cca04f16f3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:47.577447 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4ccc54ea-c44a-4def-b3b7-b9cca04f16f3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:47.577883 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4ccc54ea-c44a-4def-b3b7-b9cca04f16f3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:47.740546 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4ccc54ea-c44a-4def-b3b7-b9cca04f16f3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:47.748325 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4ccc54ea-c44a-4def-b3b7-b9cca04f16f3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:47.750029 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4ccc54ea-c44a-4def-b3b7-b9cca04f16f3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:47.752722 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-4ccc54ea-c44a-4def-b3b7-b9cca04f16f3 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1738 microversion: 2.20 time: 0.186974 May 19 06:40:47.752722 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 434/872] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:40:47 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:40:48.770166 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-56210992-f425-40dd-a2f8-72e15f345d44 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:48.771086 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-56210992-f425-40dd-a2f8-72e15f345d44 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:48.778154 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-56210992-f425-40dd-a2f8-72e15f345d44 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:48.778689 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-56210992-f425-40dd-a2f8-72e15f345d44 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:48.779523 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-56210992-f425-40dd-a2f8-72e15f345d44 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:48.780041 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-56210992-f425-40dd-a2f8-72e15f345d44 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:48.921076 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-56210992-f425-40dd-a2f8-72e15f345d44 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:48.931736 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-56210992-f425-40dd-a2f8-72e15f345d44 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:48.933329 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-56210992-f425-40dd-a2f8-72e15f345d44 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:48.934674 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-56210992-f425-40dd-a2f8-72e15f345d44 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1738 microversion: 2.20 time: 0.169441 May 19 06:40:48.935305 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 439/873] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:40:48 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:40:49.952879 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7987cc72-a6e9-4115-9ac6-b89a544b6a2e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:49.953574 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7987cc72-a6e9-4115-9ac6-b89a544b6a2e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:49.961340 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7987cc72-a6e9-4115-9ac6-b89a544b6a2e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:49.962164 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7987cc72-a6e9-4115-9ac6-b89a544b6a2e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:49.963004 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7987cc72-a6e9-4115-9ac6-b89a544b6a2e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:49.963848 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7987cc72-a6e9-4115-9ac6-b89a544b6a2e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:50.139674 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7987cc72-a6e9-4115-9ac6-b89a544b6a2e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:50.148519 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7987cc72-a6e9-4115-9ac6-b89a544b6a2e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:50.152486 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7987cc72-a6e9-4115-9ac6-b89a544b6a2e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:50.154053 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7987cc72-a6e9-4115-9ac6-b89a544b6a2e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1738 microversion: 2.20 time: 0.205144 May 19 06:40:50.165503 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 435/874] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:40:49 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1738 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:40:51.177515 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-228dea71-7a34-4b19-bd86-d9eb2ab6d6c9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:51.178292 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-228dea71-7a34-4b19-bd86-d9eb2ab6d6c9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:51.185183 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-228dea71-7a34-4b19-bd86-d9eb2ab6d6c9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:51.185675 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-228dea71-7a34-4b19-bd86-d9eb2ab6d6c9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:51.186453 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-228dea71-7a34-4b19-bd86-d9eb2ab6d6c9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:51.186887 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-228dea71-7a34-4b19-bd86-d9eb2ab6d6c9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:51.341723 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-228dea71-7a34-4b19-bd86-d9eb2ab6d6c9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:51.351542 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-228dea71-7a34-4b19-bd86-d9eb2ab6d6c9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:51.353505 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-228dea71-7a34-4b19-bd86-d9eb2ab6d6c9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:51.354353 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-228dea71-7a34-4b19-bd86-d9eb2ab6d6c9 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1738 microversion: 2.20 time: 0.182011 May 19 06:40:51.354942 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 440/875] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:40:51 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 06:40:52.373242 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f755fb11-ce6f-4d24-8fa9-e1ea691b488e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:52.373880 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f755fb11-ce6f-4d24-8fa9-e1ea691b488e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:52.380830 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f755fb11-ce6f-4d24-8fa9-e1ea691b488e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:52.381346 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f755fb11-ce6f-4d24-8fa9-e1ea691b488e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:52.382119 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f755fb11-ce6f-4d24-8fa9-e1ea691b488e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:52.382556 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f755fb11-ce6f-4d24-8fa9-e1ea691b488e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:52.616098 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f755fb11-ce6f-4d24-8fa9-e1ea691b488e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:52.624177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f755fb11-ce6f-4d24-8fa9-e1ea691b488e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:52.625721 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f755fb11-ce6f-4d24-8fa9-e1ea691b488e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:52.626905 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f755fb11-ce6f-4d24-8fa9-e1ea691b488e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1720 microversion: 2.20 time: 0.257491 May 19 06:40:52.627472 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 436/876] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:40:52 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1720 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:40:53.646427 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6fbbe291-8ae0-4cb5-bfa4-f289970367c2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:53.647064 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-6fbbe291-8ae0-4cb5-bfa4-f289970367c2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:53.653602 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6fbbe291-8ae0-4cb5-bfa4-f289970367c2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:53.654051 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6fbbe291-8ae0-4cb5-bfa4-f289970367c2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:53.654822 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6fbbe291-8ae0-4cb5-bfa4-f289970367c2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:53.655275 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6fbbe291-8ae0-4cb5-bfa4-f289970367c2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:53.792577 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6fbbe291-8ae0-4cb5-bfa4-f289970367c2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:53.800966 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6fbbe291-8ae0-4cb5-bfa4-f289970367c2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:53.802542 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6fbbe291-8ae0-4cb5-bfa4-f289970367c2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:53.803740 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6fbbe291-8ae0-4cb5-bfa4-f289970367c2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1720 microversion: 2.20 time: 0.161820 May 19 06:40:53.804303 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 441/877] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:40:53 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:40:54.821865 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a6f0d1c1-552c-493f-b879-72d2b10a72b1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:54.822498 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a6f0d1c1-552c-493f-b879-72d2b10a72b1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:54.829097 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a6f0d1c1-552c-493f-b879-72d2b10a72b1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:54.829593 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a6f0d1c1-552c-493f-b879-72d2b10a72b1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:54.830693 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a6f0d1c1-552c-493f-b879-72d2b10a72b1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:54.830861 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a6f0d1c1-552c-493f-b879-72d2b10a72b1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:54.966532 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a6f0d1c1-552c-493f-b879-72d2b10a72b1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:54.974816 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a6f0d1c1-552c-493f-b879-72d2b10a72b1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:54.976325 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a6f0d1c1-552c-493f-b879-72d2b10a72b1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:54.977530 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a6f0d1c1-552c-493f-b879-72d2b10a72b1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1663 microversion: 2.20 time: 0.159562 May 19 06:40:54.978089 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 437/878] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:40:54 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1663 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:40:54.996673 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-266c5411-543c-4cad-9470-420fb445e44f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fac1f6f4-bf9d-4a26-8cca-d3264b94a881"}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:40:54.997899 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-266c5411-543c-4cad-9470-420fb445e44f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:55.005576 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-266c5411-543c-4cad-9470-420fb445e44f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:55.006074 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-266c5411-543c-4cad-9470-420fb445e44f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:55.006860 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-266c5411-543c-4cad-9470-420fb445e44f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:55.007299 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-266c5411-543c-4cad-9470-420fb445e44f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:55.210538 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:40:55.299852 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-266c5411-543c-4cad-9470-420fb445e44f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "POST /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.307218 May 19 06:40:55.300726 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 442/879] 10.222.0.65 () {62 vars in 1363 bytes} [Thu May 19 06:40:54 2022] POST /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29/os-volume_attachments => generated 188 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 06:40:55.421175 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-db630704-afef-4808-b255-04804e3e4bd1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:55.421720 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-db630704-afef-4808-b255-04804e3e4bd1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:55.428333 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-db630704-afef-4808-b255-04804e3e4bd1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:55.428763 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-db630704-afef-4808-b255-04804e3e4bd1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:55.429562 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-db630704-afef-4808-b255-04804e3e4bd1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:55.430029 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-db630704-afef-4808-b255-04804e3e4bd1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:55.610747 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-512e86a0-33d5-456d-adf5-66ffd21502dd req-90c82df3-32e7-4b91-b80e-c312fe06073a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbdc43c2-f91a-4d38-ba69-9ca674473c29", "name": "network-vif-unplugged", "status": "completed", "tag": "57cf34a9-09b7-4eef-bf62-a47e8faa3f32"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:40:55.620669 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-512e86a0-33d5-456d-adf5-66ffd21502dd req-90c82df3-32e7-4b91-b80e-c312fe06073a service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:55.621220 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-512e86a0-33d5-456d-adf5-66ffd21502dd req-90c82df3-32e7-4b91-b80e-c312fe06073a service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:55.634719 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.compute.server_external_events [req-512e86a0-33d5-456d-adf5-66ffd21502dd req-90c82df3-32e7-4b91-b80e-c312fe06073a service nova] Unable to find a host for instance cbdc43c2-f91a-4d38-ba69-9ca674473c29. Dropping event network-vif-unplugged {{(pid=117712) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 19 06:40:55.635610 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-512e86a0-33d5-456d-adf5-66ffd21502dd req-90c82df3-32e7-4b91-b80e-c312fe06073a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028687 May 19 06:40:55.636356 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 443/880] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 19 06:40:55.698580 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-db630704-afef-4808-b255-04804e3e4bd1 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "DELETE /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29/os-volume_attachments/fac1f6f4-bf9d-4a26-8cca-d3264b94a881" status: 202 len: 0 microversion: 2.20 time: 0.281319 May 19 06:40:55.699194 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 438/881] 10.222.0.65 () {60 vars in 1456 bytes} [Thu May 19 06:40:55 2022] DELETE /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29/os-volume_attachments/fac1f6f4-bf9d-4a26-8cca-d3264b94a881 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 06:40:55.757638 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-71c671e2-1b9e-4214-977b-cabe41b5093f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:40:55.758200 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-71c671e2-1b9e-4214-977b-cabe41b5093f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:55.764301 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-71c671e2-1b9e-4214-977b-cabe41b5093f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:55.764676 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-71c671e2-1b9e-4214-977b-cabe41b5093f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:55.765480 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-71c671e2-1b9e-4214-977b-cabe41b5093f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:55.765911 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-71c671e2-1b9e-4214-977b-cabe41b5093f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:55.864365 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-71c671e2-1b9e-4214-977b-cabe41b5093f tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "POST /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29/action" status: 202 len: 0 microversion: 2.20 time: 0.110288 May 19 06:40:55.868256 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 444/882] 10.222.0.65 () {62 vars in 1318 bytes} [Thu May 19 06:40:55 2022] POST /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 06:40:55.873647 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-97c3eb67-dd1d-4f3b-bcb3-fb7cb54ab49c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:55.874767 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-97c3eb67-dd1d-4f3b-bcb3-fb7cb54ab49c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:55.882104 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-97c3eb67-dd1d-4f3b-bcb3-fb7cb54ab49c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:55.882561 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-97c3eb67-dd1d-4f3b-bcb3-fb7cb54ab49c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:55.883366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-97c3eb67-dd1d-4f3b-bcb3-fb7cb54ab49c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:55.883770 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-97c3eb67-dd1d-4f3b-bcb3-fb7cb54ab49c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:56.017971 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-97c3eb67-dd1d-4f3b-bcb3-fb7cb54ab49c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:56.026047 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-97c3eb67-dd1d-4f3b-bcb3-fb7cb54ab49c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:56.027631 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-97c3eb67-dd1d-4f3b-bcb3-fb7cb54ab49c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:56.028692 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-97c3eb67-dd1d-4f3b-bcb3-fb7cb54ab49c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1671 microversion: 2.20 time: 0.158999 May 19 06:40:56.029617 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 439/883] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:40:55 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:40:57.047506 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d2d18ac3-5df0-4821-af2e-5e407d5c8db6 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:57.048109 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d2d18ac3-5df0-4821-af2e-5e407d5c8db6 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:57.055539 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d2d18ac3-5df0-4821-af2e-5e407d5c8db6 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:57.055982 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d2d18ac3-5df0-4821-af2e-5e407d5c8db6 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:57.056737 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d2d18ac3-5df0-4821-af2e-5e407d5c8db6 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:57.057171 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d2d18ac3-5df0-4821-af2e-5e407d5c8db6 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:57.196895 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d2d18ac3-5df0-4821-af2e-5e407d5c8db6 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:57.205594 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d2d18ac3-5df0-4821-af2e-5e407d5c8db6 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:57.207068 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d2d18ac3-5df0-4821-af2e-5e407d5c8db6 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:57.209079 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d2d18ac3-5df0-4821-af2e-5e407d5c8db6 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1729 microversion: 2.20 time: 0.165424 May 19 06:40:57.209834 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 445/884] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:40:57 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:40:58.229862 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-2d4b8e26-153e-4489-8621-ef4141940dcf tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:58.231288 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-2d4b8e26-153e-4489-8621-ef4141940dcf tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:58.238036 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=31 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:40:58.240551 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2d4b8e26-153e-4489-8621-ef4141940dcf tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:58.241322 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2d4b8e26-153e-4489-8621-ef4141940dcf tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:58.242391 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2d4b8e26-153e-4489-8621-ef4141940dcf tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:58.243058 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2d4b8e26-153e-4489-8621-ef4141940dcf tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:58.248757 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:40:58.417312 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2d4b8e26-153e-4489-8621-ef4141940dcf tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:58.427322 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2d4b8e26-153e-4489-8621-ef4141940dcf tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:58.428880 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2d4b8e26-153e-4489-8621-ef4141940dcf tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:58.430192 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-2d4b8e26-153e-4489-8621-ef4141940dcf tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1729 microversion: 2.20 time: 0.204443 May 19 06:40:58.430747 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 440/885] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:40:58 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1729 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:40:59.449228 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-368e3179-eaa1-44f4-bbe2-8df522360e0c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:40:59.449940 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-368e3179-eaa1-44f4-bbe2-8df522360e0c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:40:59.452324 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=35 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:40:59.458474 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-368e3179-eaa1-44f4-bbe2-8df522360e0c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:59.459066 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-368e3179-eaa1-44f4-bbe2-8df522360e0c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:59.459835 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-368e3179-eaa1-44f4-bbe2-8df522360e0c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:40:59.460261 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-368e3179-eaa1-44f4-bbe2-8df522360e0c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:40:59.610235 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-368e3179-eaa1-44f4-bbe2-8df522360e0c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:59.622212 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-368e3179-eaa1-44f4-bbe2-8df522360e0c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:59.624021 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-368e3179-eaa1-44f4-bbe2-8df522360e0c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:40:59.625069 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-368e3179-eaa1-44f4-bbe2-8df522360e0c tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1729 microversion: 2.20 time: 0.179767 May 19 06:40:59.625663 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 446/886] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:40:59 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:41:00.646472 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-090e6942-4d74-45ab-b0c2-a01bb4348f82 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:00.648069 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-090e6942-4d74-45ab-b0c2-a01bb4348f82 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:00.654734 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-090e6942-4d74-45ab-b0c2-a01bb4348f82 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:00.655336 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-090e6942-4d74-45ab-b0c2-a01bb4348f82 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:00.656222 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-090e6942-4d74-45ab-b0c2-a01bb4348f82 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:00.656979 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-090e6942-4d74-45ab-b0c2-a01bb4348f82 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:00.806431 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-090e6942-4d74-45ab-b0c2-a01bb4348f82 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:00.814911 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-090e6942-4d74-45ab-b0c2-a01bb4348f82 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:00.816426 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-090e6942-4d74-45ab-b0c2-a01bb4348f82 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:00.817657 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-090e6942-4d74-45ab-b0c2-a01bb4348f82 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1729 microversion: 2.20 time: 0.177522 May 19 06:41:00.822706 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 441/887] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:41:00 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:41:01.837217 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-8c50acb6-1bd2-4907-b04d-3a1af2720e27 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:01.837877 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-8c50acb6-1bd2-4907-b04d-3a1af2720e27 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:01.846808 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8c50acb6-1bd2-4907-b04d-3a1af2720e27 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:01.847651 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8c50acb6-1bd2-4907-b04d-3a1af2720e27 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:01.849419 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8c50acb6-1bd2-4907-b04d-3a1af2720e27 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:01.850055 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8c50acb6-1bd2-4907-b04d-3a1af2720e27 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:02.027661 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8c50acb6-1bd2-4907-b04d-3a1af2720e27 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:02.037966 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8c50acb6-1bd2-4907-b04d-3a1af2720e27 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:02.039859 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8c50acb6-1bd2-4907-b04d-3a1af2720e27 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:02.041627 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-8c50acb6-1bd2-4907-b04d-3a1af2720e27 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1729 microversion: 2.20 time: 0.208602 May 19 06:41:02.042599 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 447/888] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:41:01 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 06:41:03.061404 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b88e38dd-bf52-4133-8166-7ec5f265e212 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:03.062110 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b88e38dd-bf52-4133-8166-7ec5f265e212 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:03.069540 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b88e38dd-bf52-4133-8166-7ec5f265e212 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:03.069998 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b88e38dd-bf52-4133-8166-7ec5f265e212 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:03.070788 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b88e38dd-bf52-4133-8166-7ec5f265e212 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:03.071225 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b88e38dd-bf52-4133-8166-7ec5f265e212 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:03.216300 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b88e38dd-bf52-4133-8166-7ec5f265e212 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:03.225707 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b88e38dd-bf52-4133-8166-7ec5f265e212 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:03.227279 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b88e38dd-bf52-4133-8166-7ec5f265e212 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:03.228421 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b88e38dd-bf52-4133-8166-7ec5f265e212 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1729 microversion: 2.20 time: 0.171052 May 19 06:41:03.229126 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 442/889] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:41:03 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:41:04.247204 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-22b79ad9-0bc5-4a55-871c-680fb46f7349 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:04.247943 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-22b79ad9-0bc5-4a55-871c-680fb46f7349 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:04.255126 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-22b79ad9-0bc5-4a55-871c-680fb46f7349 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:04.255567 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-22b79ad9-0bc5-4a55-871c-680fb46f7349 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:04.256355 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-22b79ad9-0bc5-4a55-871c-680fb46f7349 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:04.257349 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-22b79ad9-0bc5-4a55-871c-680fb46f7349 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:04.410668 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-22b79ad9-0bc5-4a55-871c-680fb46f7349 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:04.420206 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-22b79ad9-0bc5-4a55-871c-680fb46f7349 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:04.421768 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-22b79ad9-0bc5-4a55-871c-680fb46f7349 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:04.423020 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-22b79ad9-0bc5-4a55-871c-680fb46f7349 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1729 microversion: 2.20 time: 0.179878 May 19 06:41:04.423594 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 448/890] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:41:04 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:41:05.442742 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e905fed2-ef6b-4cf7-9e21-71ef4b2aa55b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:05.443368 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e905fed2-ef6b-4cf7-9e21-71ef4b2aa55b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:05.451410 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e905fed2-ef6b-4cf7-9e21-71ef4b2aa55b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:05.451994 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e905fed2-ef6b-4cf7-9e21-71ef4b2aa55b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:05.452823 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e905fed2-ef6b-4cf7-9e21-71ef4b2aa55b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:05.453267 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e905fed2-ef6b-4cf7-9e21-71ef4b2aa55b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:05.593007 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e905fed2-ef6b-4cf7-9e21-71ef4b2aa55b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:05.601154 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e905fed2-ef6b-4cf7-9e21-71ef4b2aa55b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:05.602699 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e905fed2-ef6b-4cf7-9e21-71ef4b2aa55b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:05.603860 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e905fed2-ef6b-4cf7-9e21-71ef4b2aa55b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1729 microversion: 2.20 time: 0.165004 May 19 06:41:05.604414 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 443/891] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:41:05 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:41:06.623718 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-91d142ae-dc39-4d38-88d7-a09ebe715188 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:06.624469 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-91d142ae-dc39-4d38-88d7-a09ebe715188 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:06.630792 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-91d142ae-dc39-4d38-88d7-a09ebe715188 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:06.631236 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-91d142ae-dc39-4d38-88d7-a09ebe715188 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:06.631989 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-91d142ae-dc39-4d38-88d7-a09ebe715188 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:06.632409 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-91d142ae-dc39-4d38-88d7-a09ebe715188 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:06.779329 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-91d142ae-dc39-4d38-88d7-a09ebe715188 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:06.787506 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-91d142ae-dc39-4d38-88d7-a09ebe715188 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:06.790227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-91d142ae-dc39-4d38-88d7-a09ebe715188 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:06.791400 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-91d142ae-dc39-4d38-88d7-a09ebe715188 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1729 microversion: 2.20 time: 0.171968 May 19 06:41:06.791971 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 449/892] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:41:06 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:41:06.821060 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ef51ae0e-5c56-4fb8-918a-7a8cd2449899 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:06.821618 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ef51ae0e-5c56-4fb8-918a-7a8cd2449899 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:06.829112 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ef51ae0e-5c56-4fb8-918a-7a8cd2449899 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:06.829606 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ef51ae0e-5c56-4fb8-918a-7a8cd2449899 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:06.830421 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ef51ae0e-5c56-4fb8-918a-7a8cd2449899 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:06.830861 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ef51ae0e-5c56-4fb8-918a-7a8cd2449899 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:06.857177 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ef51ae0e-5c56-4fb8-918a-7a8cd2449899 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f] Going to try to terminate instance {{(pid=117711) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 06:41:06.932369 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ef51ae0e-5c56-4fb8-918a-7a8cd2449899 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "DELETE /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f" status: 204 len: 0 microversion: 2.1 time: 0.115141 May 19 06:41:06.932957 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 444/893] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 06:41:06 2022] DELETE /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 06:41:06.941031 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2cb4d850-d5ed-4504-86d7-de129282c3ff tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:06.941646 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-2cb4d850-d5ed-4504-86d7-de129282c3ff tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:06.948218 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2cb4d850-d5ed-4504-86d7-de129282c3ff tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:06.948671 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2cb4d850-d5ed-4504-86d7-de129282c3ff tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:06.949471 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2cb4d850-d5ed-4504-86d7-de129282c3ff tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:06.949915 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2cb4d850-d5ed-4504-86d7-de129282c3ff tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:07.084063 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-2cb4d850-d5ed-4504-86d7-de129282c3ff tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:07.094556 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2cb4d850-d5ed-4504-86d7-de129282c3ff tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f" status: 200 len: 1578 microversion: 2.1 time: 0.157257 May 19 06:41:07.095126 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 450/894] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:41:06 2022] GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:41:07.811509 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5b5030ef-a985-43f2-a825-76680fac42a7 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:07.812203 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5b5030ef-a985-43f2-a825-76680fac42a7 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:07.818349 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5b5030ef-a985-43f2-a825-76680fac42a7 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:07.818817 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5b5030ef-a985-43f2-a825-76680fac42a7 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:07.819563 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5b5030ef-a985-43f2-a825-76680fac42a7 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:07.820120 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5b5030ef-a985-43f2-a825-76680fac42a7 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:07.954596 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5b5030ef-a985-43f2-a825-76680fac42a7 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:07.964179 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5b5030ef-a985-43f2-a825-76680fac42a7 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:07.965845 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5b5030ef-a985-43f2-a825-76680fac42a7 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:07.967092 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5b5030ef-a985-43f2-a825-76680fac42a7 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1729 microversion: 2.20 time: 0.159970 May 19 06:41:07.967730 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 445/895] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:41:07 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:41:08.112209 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9def276f-815b-4c34-adb7-9eec77bc2336 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:08.112839 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9def276f-815b-4c34-adb7-9eec77bc2336 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:08.120370 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9def276f-815b-4c34-adb7-9eec77bc2336 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:08.120872 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9def276f-815b-4c34-adb7-9eec77bc2336 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:08.121608 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9def276f-815b-4c34-adb7-9eec77bc2336 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:08.122038 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9def276f-815b-4c34-adb7-9eec77bc2336 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:08.258109 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9def276f-815b-4c34-adb7-9eec77bc2336 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:08.265800 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9def276f-815b-4c34-adb7-9eec77bc2336 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f" status: 200 len: 1578 microversion: 2.1 time: 0.157760 May 19 06:41:08.266359 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 451/896] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:41:08 2022] GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:41:08.985810 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f4dce107-9d66-4ed1-bc4d-de28cad28cfb tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:08.986483 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f4dce107-9d66-4ed1-bc4d-de28cad28cfb tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:08.993575 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f4dce107-9d66-4ed1-bc4d-de28cad28cfb tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:08.994022 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f4dce107-9d66-4ed1-bc4d-de28cad28cfb tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:08.994799 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f4dce107-9d66-4ed1-bc4d-de28cad28cfb tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:08.995236 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f4dce107-9d66-4ed1-bc4d-de28cad28cfb tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:09.180804 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f4dce107-9d66-4ed1-bc4d-de28cad28cfb tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:09.188979 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f4dce107-9d66-4ed1-bc4d-de28cad28cfb tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:09.190525 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f4dce107-9d66-4ed1-bc4d-de28cad28cfb tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:09.191691 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f4dce107-9d66-4ed1-bc4d-de28cad28cfb tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1729 microversion: 2.20 time: 0.209780 May 19 06:41:09.192259 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 446/897] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:41:08 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1729 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:41:09.283724 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d962565a-5682-4bd2-bf45-1698cacb8706 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:09.284352 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d962565a-5682-4bd2-bf45-1698cacb8706 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:09.297118 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d962565a-5682-4bd2-bf45-1698cacb8706 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:09.297614 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d962565a-5682-4bd2-bf45-1698cacb8706 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:09.298397 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d962565a-5682-4bd2-bf45-1698cacb8706 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:09.298830 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d962565a-5682-4bd2-bf45-1698cacb8706 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:09.404770 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d962565a-5682-4bd2-bf45-1698cacb8706 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:09.414767 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d962565a-5682-4bd2-bf45-1698cacb8706 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f" status: 200 len: 1510 microversion: 2.1 time: 0.134863 May 19 06:41:09.422290 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 452/898] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:41:09 2022] GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f => generated 1510 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:41:09.441928 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-8f8e6ce6-f256-4325-ae6c-d86b2e627830 req-82ad7854-98ad-4d9f-8fca-5ac8a7892bba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68fefa96-69e6-4e4b-86ad-b0c8bae70b5f", "name": "network-vif-deleted", "tag": "a7838485-ab2f-465d-9856-c3664945b977"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:41:09.450864 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-8f8e6ce6-f256-4325-ae6c-d86b2e627830 req-82ad7854-98ad-4d9f-8fca-5ac8a7892bba service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:09.451308 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-8f8e6ce6-f256-4325-ae6c-d86b2e627830 req-82ad7854-98ad-4d9f-8fca-5ac8a7892bba service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:09.462645 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-8f8e6ce6-f256-4325-ae6c-d86b2e627830 req-82ad7854-98ad-4d9f-8fca-5ac8a7892bba service nova] Creating event network-vif-deleted:a7838485-ab2f-465d-9856-c3664945b977 for instance 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f on hv-cinder-83699 May 19 06:41:09.467697 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-8f8e6ce6-f256-4325-ae6c-d86b2e627830 req-82ad7854-98ad-4d9f-8fca-5ac8a7892bba service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131069 May 19 06:41:09.468308 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 447/899] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:41:09.720285 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-7cb00834-1594-4f61-9702-908e852fae4e req-6a7b9a00-4b17-4c5c-8607-816e9f514661 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbdc43c2-f91a-4d38-ba69-9ca674473c29", "name": "network-vif-plugged", "status": "completed", "tag": "57cf34a9-09b7-4eef-bf62-a47e8faa3f32"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:41:09.731643 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-7cb00834-1594-4f61-9702-908e852fae4e req-6a7b9a00-4b17-4c5c-8607-816e9f514661 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:09.732118 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-7cb00834-1594-4f61-9702-908e852fae4e req-6a7b9a00-4b17-4c5c-8607-816e9f514661 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:09.743758 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-7cb00834-1594-4f61-9702-908e852fae4e req-6a7b9a00-4b17-4c5c-8607-816e9f514661 service nova] Creating event network-vif-plugged:57cf34a9-09b7-4eef-bf62-a47e8faa3f32 for instance cbdc43c2-f91a-4d38-ba69-9ca674473c29 on hv-cinder-83699 May 19 06:41:09.749155 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-7cb00834-1594-4f61-9702-908e852fae4e req-6a7b9a00-4b17-4c5c-8607-816e9f514661 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033247 May 19 06:41:09.749971 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 453/900] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:41:10.213242 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a6be4c46-7442-48b8-a8a3-664076e36713 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:10.214037 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a6be4c46-7442-48b8-a8a3-664076e36713 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:10.220573 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a6be4c46-7442-48b8-a8a3-664076e36713 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:10.221026 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a6be4c46-7442-48b8-a8a3-664076e36713 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:10.221846 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a6be4c46-7442-48b8-a8a3-664076e36713 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:10.222280 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a6be4c46-7442-48b8-a8a3-664076e36713 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:10.362391 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a6be4c46-7442-48b8-a8a3-664076e36713 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:10.370489 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a6be4c46-7442-48b8-a8a3-664076e36713 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:10.371992 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a6be4c46-7442-48b8-a8a3-664076e36713 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:10.373394 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a6be4c46-7442-48b8-a8a3-664076e36713 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1729 microversion: 2.20 time: 0.165850 May 19 06:41:10.374161 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 448/901] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:41:10 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 06:41:10.432808 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-70796175-e278-4e3f-8897-3eaa899c9dbb tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:10.433533 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-70796175-e278-4e3f-8897-3eaa899c9dbb tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:10.439740 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-70796175-e278-4e3f-8897-3eaa899c9dbb tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:10.440262 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-70796175-e278-4e3f-8897-3eaa899c9dbb tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:10.440942 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-70796175-e278-4e3f-8897-3eaa899c9dbb tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:10.441399 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-70796175-e278-4e3f-8897-3eaa899c9dbb tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:10.455309 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-70796175-e278-4e3f-8897-3eaa899c9dbb tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] HTTP exception thrown: Instance 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f could not be found. May 19 06:41:10.457067 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-70796175-e278-4e3f-8897-3eaa899c9dbb tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Request method failure captured: May 19 06:41:10.457067 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f HTTP/1.1 May 19 06:41:10.457067 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept: application/json May 19 06:41:10.457067 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity May 19 06:41:10.457067 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Connection: close May 19 06:41:10.457067 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Length: 0 May 19 06:41:10.457067 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Type: application/json May 19 06:41:10.457067 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Host: 10.222.0.65 May 19 06:41:10.457067 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None May 19 06:41:10.457067 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 May 19 06:41:10.457067 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiheXall9X50KtUoZq9BPO9h6Yh2juusugfh8Sq73pNXs2xGe2hGmMnOTHDMSF5p6yV7wLf7AFdaImgynbtulmSQiGJTUoNfpnNILlvmbC7F63-nq-xi2381Q4AbJDMgHzqbWyUKas4MHnelO6PbPnJnZsnt76MOtJLHSOFX7LBJuM6CY May 19 06:41:10.457067 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Id: None May 19 06:41:10.457067 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Name: None May 19 06:41:10.457067 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed May 19 06:41:10.457067 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True May 19 06:41:10.457067 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default May 19 06:41:10.457067 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default May 19 06:41:10.457067 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Id: 318e4e0d9f3a49f69eb3d846539b6b67 May 19 06:41:10.457067 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-TestVolumeBootPattern-1895289434 May 19 06:41:10.457067 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Role: reader,member May 19 06:41:10.457067 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Roles: reader,member May 19 06:41:10.458853 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/318e4e0d9f3a49f69eb3d846539b6b67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/318e4e0d9f3a49f69eb3d846539b6b67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/318e4e0d9f3a49f69eb3d846539b6b67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_318e4e0d9f3a49f69eb3d846539b6b67", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:41:10.458853 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-TestVolumeBootPattern-1895289434 May 19 06:41:10.458853 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Id: 318e4e0d9f3a49f69eb3d846539b6b67 May 19 06:41:10.458853 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-TestVolumeBootPattern-1895289434 May 19 06:41:10.458853 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User: tempest-TestVolumeBootPattern-1895289434-project May 19 06:41:10.458853 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default May 19 06:41:10.458853 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default May 19 06:41:10.458853 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Id: c1815cc5a2fd43259c5b53650dbc7603 May 19 06:41:10.458853 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-TestVolumeBootPattern-1895289434-project May 19 06:41:10.458853 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: method: > May 19 06:41:10.458853 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: exception: Instance 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f could not be found. May 19 06:41:10.458853 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: action_args: {'id': '68fefa96-69e6-4e4b-86ad-b0c8bae70b5f'} May 19 06:41:10.460561 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:41:10.460561 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:41:10.460561 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:41:10.460561 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:41:10.460561 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:41:10.460561 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:41:10.460561 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:41:10.460561 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:41:10.460561 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:41:10.460561 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:41:10.460561 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f could not be found. May 19 06:41:10.460561 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:41:10.460561 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:41:10.460561 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:41:10.460561 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:41:10.460561 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:41:10.460561 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:41:10.460561 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:41:10.460561 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:41:10.460561 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:41:10.462360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:41:10.462360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:41:10.462360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:41:10.462360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:41:10.462360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:41:10.462360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:41:10.462360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:41:10.462360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f could not be found. May 19 06:41:10.462360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:41:10.462360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:41:10.462360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:41:10.462360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:41:10.462360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:41:10.462360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:41:10.462360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:41:10.462360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:41:10.462360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f could not be found. May 19 06:41:10.462360 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:41:10.463787 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-70796175-e278-4e3f-8897-3eaa899c9dbb tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Returning 404 to user: Instance 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:41:10.463787 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-70796175-e278-4e3f-8897-3eaa899c9dbb tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f" status: 404 len: 111 microversion: 2.1 time: 0.031041 May 19 06:41:10.463787 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 454/902] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:41:10 2022] GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:41:10.604521 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-00c787bf-5fd4-4c4f-8c73-58469fcd4423 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-782635600", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1671934445", "security_groups": [{"name": "tempest-secgroup-smoke-1964986703"}], "block_device_mapping_v2": [{"uuid": "4d8f40ed-71c7-4b35-92c4-17a5dcbaf564", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cf104e4d-072e-4746-a72c-c14fb907651b"}]}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:41:10.718680 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.network.neutron [None req-00c787bf-5fd4-4c4f-8c73-58469fcd4423 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] validate_networks() for [('cf104e4d-072e-4746-a72c-c14fb907651b', None, None, None, None, None)] {{(pid=117711) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 06:41:11.137867 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-00c787bf-5fd4-4c4f-8c73-58469fcd4423 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Flavor limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 06:41:11.138285 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-00c787bf-5fd4-4c4f-8c73-58469fcd4423 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Image limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 06:41:11.138749 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-00c787bf-5fd4-4c4f-8c73-58469fcd4423 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Flavor pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 06:41:11.139165 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-00c787bf-5fd4-4c4f-8c73-58469fcd4423 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Image pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 06:41:11.139605 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-00c787bf-5fd4-4c4f-8c73-58469fcd4423 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 06:41:11.149873 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-00c787bf-5fd4-4c4f-8c73-58469fcd4423 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:11.150396 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-00c787bf-5fd4-4c4f-8c73-58469fcd4423 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:11.151190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-00c787bf-5fd4-4c4f-8c73-58469fcd4423 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:11.151627 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-00c787bf-5fd4-4c4f-8c73-58469fcd4423 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:11.168783 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-00c787bf-5fd4-4c4f-8c73-58469fcd4423 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Getting quotas for project 318e4e0d9f3a49f69eb3d846539b6b67. Resources: {'ram', 'cores', 'instances'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:41:11.172794 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-00c787bf-5fd4-4c4f-8c73-58469fcd4423 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Getting quotas for user c1815cc5a2fd43259c5b53650dbc7603 and project 318e4e0d9f3a49f69eb3d846539b6b67. Resources: {'ram', 'cores', 'instances'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:41:11.231286 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-00c787bf-5fd4-4c4f-8c73-58469fcd4423 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Going to run 1 instances... {{(pid=117711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 06:41:11.233383 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-00c787bf-5fd4-4c4f-8c73-58469fcd4423 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: b30b7860-ca60-424f-9480-55dd00c344b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4d8f40ed-71c7-4b35-92c4-17a5dcbaf564',volume_size=None,volume_type=None)] {{(pid=117711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 06:41:11.391359 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-00c787bf-5fd4-4c4f-8c73-58469fcd4423 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.790644 May 19 06:41:11.392421 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 449/903] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 06:41:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 06:41:11.394446 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-8500bf40-5702-4da9-b869-9103aa784f8e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:11.395522 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-8500bf40-5702-4da9-b869-9103aa784f8e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:11.406206 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8500bf40-5702-4da9-b869-9103aa784f8e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:11.407180 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8500bf40-5702-4da9-b869-9103aa784f8e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:11.407970 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8500bf40-5702-4da9-b869-9103aa784f8e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:11.408395 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8500bf40-5702-4da9-b869-9103aa784f8e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:11.408587 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d5a40341-9abe-4988-a93f-16af43709671 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:11.409470 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d5a40341-9abe-4988-a93f-16af43709671 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: b30b7860-ca60-424f-9480-55dd00c344b3] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:11.501518 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d5a40341-9abe-4988-a93f-16af43709671 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:11.512066 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d5a40341-9abe-4988-a93f-16af43709671 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3" status: 200 len: 1094 microversion: 2.1 time: 0.111244 May 19 06:41:11.513248 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 450/904] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:41:11 2022] GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3 => generated 1094 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:41:11.589113 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8500bf40-5702-4da9-b869-9103aa784f8e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:11.597489 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8500bf40-5702-4da9-b869-9103aa784f8e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:11.598999 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8500bf40-5702-4da9-b869-9103aa784f8e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:11.600164 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-8500bf40-5702-4da9-b869-9103aa784f8e tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1729 microversion: 2.20 time: 0.211852 May 19 06:41:11.611424 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 455/905] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:41:11 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1729 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:41:12.530156 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-095ff6ea-f7c0-4661-8950-c63a41491a6b tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:12.530877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-095ff6ea-f7c0-4661-8950-c63a41491a6b tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: b30b7860-ca60-424f-9480-55dd00c344b3] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:12.538559 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-095ff6ea-f7c0-4661-8950-c63a41491a6b tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:12.539521 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-095ff6ea-f7c0-4661-8950-c63a41491a6b tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:12.540370 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-095ff6ea-f7c0-4661-8950-c63a41491a6b tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:12.540871 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-095ff6ea-f7c0-4661-8950-c63a41491a6b tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:12.619205 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-02705551-2918-42d4-9727-988a478cb211 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:12.619778 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-02705551-2918-42d4-9727-988a478cb211 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:12.626328 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-02705551-2918-42d4-9727-988a478cb211 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:12.626771 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-02705551-2918-42d4-9727-988a478cb211 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:12.627533 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-02705551-2918-42d4-9727-988a478cb211 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:12.627961 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-02705551-2918-42d4-9727-988a478cb211 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:12.642400 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-095ff6ea-f7c0-4661-8950-c63a41491a6b tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:12.651481 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-095ff6ea-f7c0-4661-8950-c63a41491a6b tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3" status: 200 len: 1210 microversion: 2.1 time: 0.125486 May 19 06:41:12.652162 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 451/906] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:41:12 2022] GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3 => generated 1210 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:41:12.772983 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-02705551-2918-42d4-9727-988a478cb211 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:12.782311 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-02705551-2918-42d4-9727-988a478cb211 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:12.783840 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-02705551-2918-42d4-9727-988a478cb211 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:12.785006 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-02705551-2918-42d4-9727-988a478cb211 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1716 microversion: 2.20 time: 0.170450 May 19 06:41:12.785596 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 456/907] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:41:12 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1716 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 06:41:13.669693 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-bb0ba336-9879-4116-bf8d-8956e5d141b7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:13.670426 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-bb0ba336-9879-4116-bf8d-8956e5d141b7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: b30b7860-ca60-424f-9480-55dd00c344b3] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:13.677198 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bb0ba336-9879-4116-bf8d-8956e5d141b7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:13.677801 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bb0ba336-9879-4116-bf8d-8956e5d141b7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:13.679238 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bb0ba336-9879-4116-bf8d-8956e5d141b7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:13.679892 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bb0ba336-9879-4116-bf8d-8956e5d141b7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:13.897360 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-bb0ba336-9879-4116-bf8d-8956e5d141b7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:13.905057 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-bb0ba336-9879-4116-bf8d-8956e5d141b7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3" status: 200 len: 1266 microversion: 2.1 time: 0.240341 May 19 06:41:13.905652 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 452/908] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:41:13 2022] GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:41:13.936725 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-fc449e44-0479-45a5-9ed8-692d0d00ba2f req-24581c12-bf21-4019-b002-21a7f06ff59e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b30b7860-ca60-424f-9480-55dd00c344b3", "tag": "4ec87ea5-0d1a-4118-90d2-4552a0351194"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:41:13.946049 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-fc449e44-0479-45a5-9ed8-692d0d00ba2f req-24581c12-bf21-4019-b002-21a7f06ff59e service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:13.946716 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-fc449e44-0479-45a5-9ed8-692d0d00ba2f req-24581c12-bf21-4019-b002-21a7f06ff59e service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:13.963450 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-fc449e44-0479-45a5-9ed8-692d0d00ba2f req-24581c12-bf21-4019-b002-21a7f06ff59e service nova] Creating event network-changed:4ec87ea5-0d1a-4118-90d2-4552a0351194 for instance b30b7860-ca60-424f-9480-55dd00c344b3 on hv-cinder-83699 May 19 06:41:13.968539 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-fc449e44-0479-45a5-9ed8-692d0d00ba2f req-24581c12-bf21-4019-b002-21a7f06ff59e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036135 May 19 06:41:13.969560 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 457/909] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:41:14.923223 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3b16bba7-f9e1-43ad-b613-264775d77c93 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:14.923798 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-3b16bba7-f9e1-43ad-b613-264775d77c93 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: b30b7860-ca60-424f-9480-55dd00c344b3] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:14.931839 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3b16bba7-f9e1-43ad-b613-264775d77c93 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:14.932214 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3b16bba7-f9e1-43ad-b613-264775d77c93 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:14.932986 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3b16bba7-f9e1-43ad-b613-264775d77c93 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:14.933452 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3b16bba7-f9e1-43ad-b613-264775d77c93 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:15.131454 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3b16bba7-f9e1-43ad-b613-264775d77c93 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:15.139522 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-3b16bba7-f9e1-43ad-b613-264775d77c93 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3" status: 200 len: 1266 microversion: 2.1 time: 0.220347 May 19 06:41:15.140098 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 453/910] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:41:14 2022] GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:41:16.157929 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3f4de780-f1ee-4f96-a969-0906c13aed05 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:16.158621 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3f4de780-f1ee-4f96-a969-0906c13aed05 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: b30b7860-ca60-424f-9480-55dd00c344b3] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:16.164960 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3f4de780-f1ee-4f96-a969-0906c13aed05 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:16.165439 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3f4de780-f1ee-4f96-a969-0906c13aed05 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:16.166194 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3f4de780-f1ee-4f96-a969-0906c13aed05 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:16.166622 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3f4de780-f1ee-4f96-a969-0906c13aed05 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:16.311181 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3f4de780-f1ee-4f96-a969-0906c13aed05 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:16.318826 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3f4de780-f1ee-4f96-a969-0906c13aed05 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3" status: 200 len: 1266 microversion: 2.1 time: 0.165907 May 19 06:41:16.319888 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 458/911] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:41:16 2022] GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:41:17.336812 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-16eb6b7c-8a57-44d7-b90f-958deb459ae1 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:17.337367 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-16eb6b7c-8a57-44d7-b90f-958deb459ae1 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: b30b7860-ca60-424f-9480-55dd00c344b3] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:17.344325 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-16eb6b7c-8a57-44d7-b90f-958deb459ae1 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:17.344766 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-16eb6b7c-8a57-44d7-b90f-958deb459ae1 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:17.345557 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-16eb6b7c-8a57-44d7-b90f-958deb459ae1 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:17.345986 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-16eb6b7c-8a57-44d7-b90f-958deb459ae1 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:17.478724 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-16eb6b7c-8a57-44d7-b90f-958deb459ae1 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:17.486151 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-16eb6b7c-8a57-44d7-b90f-958deb459ae1 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3" status: 200 len: 1266 microversion: 2.1 time: 0.153926 May 19 06:41:17.486713 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 454/912] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:41:17 2022] GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:41:18.503059 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-381f517c-5a97-4a43-93d4-23d20f0d5293 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:18.503675 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-381f517c-5a97-4a43-93d4-23d20f0d5293 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: b30b7860-ca60-424f-9480-55dd00c344b3] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:18.510331 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-381f517c-5a97-4a43-93d4-23d20f0d5293 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:18.510779 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-381f517c-5a97-4a43-93d4-23d20f0d5293 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:18.511541 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-381f517c-5a97-4a43-93d4-23d20f0d5293 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:18.511977 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-381f517c-5a97-4a43-93d4-23d20f0d5293 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:18.643378 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-381f517c-5a97-4a43-93d4-23d20f0d5293 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:18.650780 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-381f517c-5a97-4a43-93d4-23d20f0d5293 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3" status: 200 len: 1266 microversion: 2.1 time: 0.151701 May 19 06:41:18.651365 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 459/913] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:41:18 2022] GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:41:19.668086 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-9c49bbde-0d7c-4123-a40b-b06297b560f7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:19.668689 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-9c49bbde-0d7c-4123-a40b-b06297b560f7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: b30b7860-ca60-424f-9480-55dd00c344b3] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:19.675286 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9c49bbde-0d7c-4123-a40b-b06297b560f7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:19.675731 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9c49bbde-0d7c-4123-a40b-b06297b560f7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:19.676501 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9c49bbde-0d7c-4123-a40b-b06297b560f7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:19.676959 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9c49bbde-0d7c-4123-a40b-b06297b560f7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:19.815186 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9c49bbde-0d7c-4123-a40b-b06297b560f7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:19.823363 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-9c49bbde-0d7c-4123-a40b-b06297b560f7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3" status: 200 len: 1266 microversion: 2.1 time: 0.159164 May 19 06:41:19.823930 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 455/914] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:41:19 2022] GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:41:20.839991 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4191a870-64b6-4ebe-89da-e05a9763dfae tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:20.840660 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4191a870-64b6-4ebe-89da-e05a9763dfae tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: b30b7860-ca60-424f-9480-55dd00c344b3] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:20.847187 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4191a870-64b6-4ebe-89da-e05a9763dfae tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:20.847632 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4191a870-64b6-4ebe-89da-e05a9763dfae tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:20.848381 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4191a870-64b6-4ebe-89da-e05a9763dfae tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:20.848804 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4191a870-64b6-4ebe-89da-e05a9763dfae tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:20.853464 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=95,nova_cell1:UPDATE=3 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:41:20.980721 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-4191a870-64b6-4ebe-89da-e05a9763dfae tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:20.988460 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4191a870-64b6-4ebe-89da-e05a9763dfae tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3" status: 200 len: 1266 microversion: 2.1 time: 0.152388 May 19 06:41:20.989027 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 460/915] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:41:20 2022] GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:41:22.005631 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8f8d701f-9668-424a-b1c9-7aa84debd02e tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:22.006248 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8f8d701f-9668-424a-b1c9-7aa84debd02e tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: b30b7860-ca60-424f-9480-55dd00c344b3] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:22.009272 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:41:22.009974 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=8 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:41:22.015624 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8f8d701f-9668-424a-b1c9-7aa84debd02e tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:22.016074 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8f8d701f-9668-424a-b1c9-7aa84debd02e tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:22.016861 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8f8d701f-9668-424a-b1c9-7aa84debd02e tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:22.017354 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8f8d701f-9668-424a-b1c9-7aa84debd02e tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:22.161705 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-8f8d701f-9668-424a-b1c9-7aa84debd02e tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:22.170557 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8f8d701f-9668-424a-b1c9-7aa84debd02e tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3" status: 200 len: 1266 microversion: 2.1 time: 0.168676 May 19 06:41:22.171160 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 456/916] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:41:22 2022] GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:41:23.187942 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b306ff14-cb43-4105-9fe7-9fc59a09aa60 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:23.189237 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b306ff14-cb43-4105-9fe7-9fc59a09aa60 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: b30b7860-ca60-424f-9480-55dd00c344b3] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:23.195731 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b306ff14-cb43-4105-9fe7-9fc59a09aa60 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:23.196178 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b306ff14-cb43-4105-9fe7-9fc59a09aa60 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:23.196931 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b306ff14-cb43-4105-9fe7-9fc59a09aa60 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:23.197392 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b306ff14-cb43-4105-9fe7-9fc59a09aa60 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:23.326671 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b306ff14-cb43-4105-9fe7-9fc59a09aa60 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:23.334141 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b306ff14-cb43-4105-9fe7-9fc59a09aa60 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3" status: 200 len: 1266 microversion: 2.1 time: 0.150133 May 19 06:41:23.334877 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 461/917] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:41:23 2022] GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:41:23.774487 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-e631d515-60c9-4e98-9ed2-d709b9fd1b82 req-4b7e3114-e5b6-421f-b729-6ae41da54de2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b30b7860-ca60-424f-9480-55dd00c344b3", "name": "network-vif-plugged", "status": "completed", "tag": "4ec87ea5-0d1a-4118-90d2-4552a0351194"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:41:23.783548 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-e631d515-60c9-4e98-9ed2-d709b9fd1b82 req-4b7e3114-e5b6-421f-b729-6ae41da54de2 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:23.783984 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-e631d515-60c9-4e98-9ed2-d709b9fd1b82 req-4b7e3114-e5b6-421f-b729-6ae41da54de2 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:23.796171 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-e631d515-60c9-4e98-9ed2-d709b9fd1b82 req-4b7e3114-e5b6-421f-b729-6ae41da54de2 service nova] Creating event network-vif-plugged:4ec87ea5-0d1a-4118-90d2-4552a0351194 for instance b30b7860-ca60-424f-9480-55dd00c344b3 on hv-cinder-83699 May 19 06:41:23.801053 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-e631d515-60c9-4e98-9ed2-d709b9fd1b82 req-4b7e3114-e5b6-421f-b729-6ae41da54de2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030346 May 19 06:41:23.801677 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 457/918] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:41:24.351223 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2a9d9223-d03b-471e-8c1a-3094bcb5bca9 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:24.351741 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-2a9d9223-d03b-471e-8c1a-3094bcb5bca9 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: b30b7860-ca60-424f-9480-55dd00c344b3] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:24.358238 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2a9d9223-d03b-471e-8c1a-3094bcb5bca9 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:24.358680 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2a9d9223-d03b-471e-8c1a-3094bcb5bca9 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:24.359432 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2a9d9223-d03b-471e-8c1a-3094bcb5bca9 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:24.359860 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2a9d9223-d03b-471e-8c1a-3094bcb5bca9 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:24.491413 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-2a9d9223-d03b-471e-8c1a-3094bcb5bca9 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:24.498648 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2a9d9223-d03b-471e-8c1a-3094bcb5bca9 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3" status: 200 len: 1266 microversion: 2.1 time: 0.151452 May 19 06:41:24.499207 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 462/919] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:41:24 2022] GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:41:25.516702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c3035509-636b-498f-83a0-f11c88b64dde tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:25.517418 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c3035509-636b-498f-83a0-f11c88b64dde tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: b30b7860-ca60-424f-9480-55dd00c344b3] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:25.523683 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c3035509-636b-498f-83a0-f11c88b64dde tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:25.524133 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c3035509-636b-498f-83a0-f11c88b64dde tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:25.524896 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c3035509-636b-498f-83a0-f11c88b64dde tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:25.525360 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c3035509-636b-498f-83a0-f11c88b64dde tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:25.528082 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:41:25.663294 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c3035509-636b-498f-83a0-f11c88b64dde tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:25.670899 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c3035509-636b-498f-83a0-f11c88b64dde tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3" status: 200 len: 1454 microversion: 2.1 time: 0.159078 May 19 06:41:25.671502 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 458/920] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:41:25 2022] GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3 => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:41:25.687214 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-86eab656-b713-4d7a-9cc3-82e0f76c7e54 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:25.687821 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-86eab656-b713-4d7a-9cc3-82e0f76c7e54 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: b30b7860-ca60-424f-9480-55dd00c344b3] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:25.695049 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-86eab656-b713-4d7a-9cc3-82e0f76c7e54 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:25.695490 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-86eab656-b713-4d7a-9cc3-82e0f76c7e54 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:25.696247 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-86eab656-b713-4d7a-9cc3-82e0f76c7e54 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:25.696673 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-86eab656-b713-4d7a-9cc3-82e0f76c7e54 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:25.828486 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-86eab656-b713-4d7a-9cc3-82e0f76c7e54 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:25.836358 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-86eab656-b713-4d7a-9cc3-82e0f76c7e54 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3" status: 200 len: 1454 microversion: 2.1 time: 0.152991 May 19 06:41:25.836920 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 463/921] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:41:25 2022] GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:41:27.710528 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-7515ae72-cd5c-4f96-8b32-7c0c31ff6e68 req-f6575f3f-9ba2-4234-9145-5b480e0f0098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b30b7860-ca60-424f-9480-55dd00c344b3", "tag": "4ec87ea5-0d1a-4118-90d2-4552a0351194"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:41:27.719520 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-7515ae72-cd5c-4f96-8b32-7c0c31ff6e68 req-f6575f3f-9ba2-4234-9145-5b480e0f0098 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:27.720265 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-7515ae72-cd5c-4f96-8b32-7c0c31ff6e68 req-f6575f3f-9ba2-4234-9145-5b480e0f0098 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:27.731331 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-7515ae72-cd5c-4f96-8b32-7c0c31ff6e68 req-f6575f3f-9ba2-4234-9145-5b480e0f0098 service nova] Creating event network-changed:4ec87ea5-0d1a-4118-90d2-4552a0351194 for instance b30b7860-ca60-424f-9480-55dd00c344b3 on hv-cinder-83699 May 19 06:41:27.736574 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-7515ae72-cd5c-4f96-8b32-7c0c31ff6e68 req-f6575f3f-9ba2-4234-9145-5b480e0f0098 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029992 May 19 06:41:27.737149 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 459/922] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:41:45.654196 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-86966502-7b9b-47ee-875b-076288a35cdf tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:45.655174 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-86966502-7b9b-47ee-875b-076288a35cdf tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:45.657626 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=35 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:41:45.658282 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=22 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:41:45.664143 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-86966502-7b9b-47ee-875b-076288a35cdf tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:45.665227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-86966502-7b9b-47ee-875b-076288a35cdf tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:45.666019 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-86966502-7b9b-47ee-875b-076288a35cdf tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:45.666451 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-86966502-7b9b-47ee-875b-076288a35cdf tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:45.697338 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-86966502-7b9b-47ee-875b-076288a35cdf tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046990 May 19 06:41:45.697915 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 464/923] 10.222.0.65 () {60 vars in 1342 bytes} [Thu May 19 06:41:45 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:41:45.755702 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:41:45.756438 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=7 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:41:45.760633 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-fb43a410-4b39-4c1d-8821-3ea168aa6be5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:45.761210 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-fb43a410-4b39-4c1d-8821-3ea168aa6be5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:45.768788 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fb43a410-4b39-4c1d-8821-3ea168aa6be5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:45.769230 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fb43a410-4b39-4c1d-8821-3ea168aa6be5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:45.770045 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fb43a410-4b39-4c1d-8821-3ea168aa6be5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:45.770476 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fb43a410-4b39-4c1d-8821-3ea168aa6be5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:45.796676 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-fb43a410-4b39-4c1d-8821-3ea168aa6be5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Going to try to terminate instance {{(pid=117711) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 06:41:45.872151 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-fb43a410-4b39-4c1d-8821-3ea168aa6be5 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "DELETE /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 204 len: 0 microversion: 2.20 time: 0.117735 May 19 06:41:45.872754 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 460/924] 10.222.0.65 () {60 vars in 1279 bytes} [Thu May 19 06:41:45 2022] DELETE /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 06:41:45.882432 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-71a5420e-efdb-4750-b6e1-63d99ee65085 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:45.883545 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-71a5420e-efdb-4750-b6e1-63d99ee65085 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:45.892014 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-71a5420e-efdb-4750-b6e1-63d99ee65085 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:45.892460 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-71a5420e-efdb-4750-b6e1-63d99ee65085 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:45.893231 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-71a5420e-efdb-4750-b6e1-63d99ee65085 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:45.893691 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-71a5420e-efdb-4750-b6e1-63d99ee65085 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:46.027998 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-71a5420e-efdb-4750-b6e1-63d99ee65085 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:46.036433 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-71a5420e-efdb-4750-b6e1-63d99ee65085 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:46.037980 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-71a5420e-efdb-4750-b6e1-63d99ee65085 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:46.039342 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-71a5420e-efdb-4750-b6e1-63d99ee65085 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1722 microversion: 2.20 time: 0.161583 May 19 06:41:46.039934 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 465/925] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:41:45 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:41:47.058039 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-10abff5f-cd7e-449f-ab9c-003b668c1401 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:47.058726 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-10abff5f-cd7e-449f-ab9c-003b668c1401 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:47.065115 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-10abff5f-cd7e-449f-ab9c-003b668c1401 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:47.065581 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-10abff5f-cd7e-449f-ab9c-003b668c1401 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:47.066330 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-10abff5f-cd7e-449f-ab9c-003b668c1401 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:47.066755 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-10abff5f-cd7e-449f-ab9c-003b668c1401 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:47.205432 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-10abff5f-cd7e-449f-ab9c-003b668c1401 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:47.213322 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-10abff5f-cd7e-449f-ab9c-003b668c1401 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:47.214814 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-10abff5f-cd7e-449f-ab9c-003b668c1401 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:47.215954 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-10abff5f-cd7e-449f-ab9c-003b668c1401 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1722 microversion: 2.20 time: 0.162392 May 19 06:41:47.216515 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 461/926] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:41:47 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:41:48.108257 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-2c274634-435b-4dda-bef5-c30c442b7a22 req-3c1aeee2-7171-4757-9fd3-f0a8f5c08fee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbdc43c2-f91a-4d38-ba69-9ca674473c29", "name": "network-vif-deleted", "tag": "57cf34a9-09b7-4eef-bf62-a47e8faa3f32"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:41:48.116698 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-2c274634-435b-4dda-bef5-c30c442b7a22 req-3c1aeee2-7171-4757-9fd3-f0a8f5c08fee service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:48.117297 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-2c274634-435b-4dda-bef5-c30c442b7a22 req-3c1aeee2-7171-4757-9fd3-f0a8f5c08fee service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:48.129930 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-2c274634-435b-4dda-bef5-c30c442b7a22 req-3c1aeee2-7171-4757-9fd3-f0a8f5c08fee service nova] Creating event network-vif-deleted:57cf34a9-09b7-4eef-bf62-a47e8faa3f32 for instance cbdc43c2-f91a-4d38-ba69-9ca674473c29 on hv-cinder-83699 May 19 06:41:48.135911 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-2c274634-435b-4dda-bef5-c30c442b7a22 req-3c1aeee2-7171-4757-9fd3-f0a8f5c08fee service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031949 May 19 06:41:48.136487 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 466/927] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:41:48.234381 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3fa6489c-af0b-4570-a243-260ff4e138e2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:48.235003 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-3fa6489c-af0b-4570-a243-260ff4e138e2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:48.242278 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3fa6489c-af0b-4570-a243-260ff4e138e2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:48.247243 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3fa6489c-af0b-4570-a243-260ff4e138e2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:48.248427 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3fa6489c-af0b-4570-a243-260ff4e138e2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:48.248866 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3fa6489c-af0b-4570-a243-260ff4e138e2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:48.285018 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3fa6489c-af0b-4570-a243-260ff4e138e2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:48.285560 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3fa6489c-af0b-4570-a243-260ff4e138e2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:48.286020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-3fa6489c-af0b-4570-a243-260ff4e138e2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lazy-loading 'fault' on Instance uuid cbdc43c2-f91a-4d38-ba69-9ca674473c29 {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:41:48.338770 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3fa6489c-af0b-4570-a243-260ff4e138e2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:48.347494 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3fa6489c-af0b-4570-a243-260ff4e138e2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:48.349458 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3fa6489c-af0b-4570-a243-260ff4e138e2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a8abbf889e149f5be25ecddb22384a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21ed8d40dab40828a1fc685ca63ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:41:48.350658 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-3fa6489c-af0b-4570-a243-260ff4e138e2 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 200 len: 1371 microversion: 2.20 time: 0.120216 May 19 06:41:48.351290 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 462/928] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:41:48 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 1371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 06:41:49.371800 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0758ee53-d6ee-4d0e-a228-c5dc33612a5b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:49.372439 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0758ee53-d6ee-4d0e-a228-c5dc33612a5b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:49.378794 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0758ee53-d6ee-4d0e-a228-c5dc33612a5b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:49.379236 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0758ee53-d6ee-4d0e-a228-c5dc33612a5b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:49.379983 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0758ee53-d6ee-4d0e-a228-c5dc33612a5b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:49.380412 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0758ee53-d6ee-4d0e-a228-c5dc33612a5b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:49.394479 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-0758ee53-d6ee-4d0e-a228-c5dc33612a5b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] HTTP exception thrown: Instance cbdc43c2-f91a-4d38-ba69-9ca674473c29 could not be found. May 19 06:41:49.396101 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0758ee53-d6ee-4d0e-a228-c5dc33612a5b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Request method failure captured: May 19 06:41:49.396101 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 HTTP/1.1 May 19 06:41:49.396101 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept: application/json May 19 06:41:49.396101 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity May 19 06:41:49.396101 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Connection: close May 19 06:41:49.396101 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Length: 0 May 19 06:41:49.396101 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Type: application/json May 19 06:41:49.396101 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Host: 10.222.0.65 May 19 06:41:49.396101 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None May 19 06:41:49.396101 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 May 19 06:41:49.396101 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiheWD6cQhjZG-XwixYSXIkUEMkJ-sOE63Sa9pijFv9NBliLzJlR7V-ObuT2TtIZVIefICt7JgdZX4HH0xGivixZxbQmE2Hv2v4q2Q-vgaVY7mFxaKWhSBXCUQTru8LLX4DjdP7YGJWOJAJhTcdsulI-9frBxJlpkQotDIqllulRNMLs0 May 19 06:41:49.396101 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Id: None May 19 06:41:49.396101 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Name: None May 19 06:41:49.396101 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed May 19 06:41:49.396101 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True May 19 06:41:49.396101 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Openstack-Nova-Api-Version: 2.20 May 19 06:41:49.396101 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default May 19 06:41:49.396101 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default May 19 06:41:49.396101 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Id: e21ed8d40dab40828a1fc685ca63ad92 May 19 06:41:49.396101 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-125467305 May 19 06:41:49.396101 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Role: reader,member May 19 06:41:49.396101 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Roles: reader,member May 19 06:41:49.397967 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e21ed8d40dab40828a1fc685ca63ad92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e21ed8d40dab40828a1fc685ca63ad92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e21ed8d40dab40828a1fc685ca63ad92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e21ed8d40dab40828a1fc685ca63ad92", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:41:49.397967 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-AttachVolumeShelveTestJSON-125467305 May 19 06:41:49.397967 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Id: e21ed8d40dab40828a1fc685ca63ad92 May 19 06:41:49.397967 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-125467305 May 19 06:41:49.397967 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User: tempest-AttachVolumeShelveTestJSON-125467305-project May 19 06:41:49.397967 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default May 19 06:41:49.397967 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default May 19 06:41:49.397967 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Id: 3a8abbf889e149f5be25ecddb22384a5 May 19 06:41:49.397967 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-AttachVolumeShelveTestJSON-125467305-project May 19 06:41:49.397967 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: method: > May 19 06:41:49.397967 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: exception: Instance cbdc43c2-f91a-4d38-ba69-9ca674473c29 could not be found. May 19 06:41:49.397967 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: action_args: {'id': 'cbdc43c2-f91a-4d38-ba69-9ca674473c29'} May 19 06:41:49.398997 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:41:49.398997 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:41:49.398997 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:41:49.398997 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:41:49.398997 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:41:49.398997 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:41:49.398997 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:41:49.398997 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:41:49.398997 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:41:49.398997 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:41:49.398997 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbdc43c2-f91a-4d38-ba69-9ca674473c29 could not be found. May 19 06:41:49.398997 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:41:49.398997 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:41:49.398997 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:41:49.398997 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:41:49.398997 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:41:49.398997 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:41:49.398997 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:41:49.398997 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:41:49.398997 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:41:49.400703 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:41:49.400703 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:41:49.400703 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:41:49.400703 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:41:49.400703 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:41:49.400703 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:41:49.400703 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:41:49.400703 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbdc43c2-f91a-4d38-ba69-9ca674473c29 could not be found. May 19 06:41:49.400703 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:41:49.400703 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:41:49.400703 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:41:49.400703 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:41:49.400703 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:41:49.400703 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:41:49.400703 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:41:49.400703 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:41:49.400703 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbdc43c2-f91a-4d38-ba69-9ca674473c29 could not be found. May 19 06:41:49.400703 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:41:49.402191 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0758ee53-d6ee-4d0e-a228-c5dc33612a5b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Returning 404 to user: Instance cbdc43c2-f91a-4d38-ba69-9ca674473c29 could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:41:49.402191 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0758ee53-d6ee-4d0e-a228-c5dc33612a5b tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 404 len: 111 microversion: 2.20 time: 0.031282 May 19 06:41:49.402191 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 467/929] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:41:49 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 06:41:49.406668 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-19d55e6b-7024-41da-b544-bfec9f1c9081 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '.version_select at 0x7f9aeb3f7ee0>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:49.427618 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-19d55e6b-7024-41da-b544-bfec9f1c9081 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2040039853" status: 204 len: 0 microversion: 2.20 time: 0.024645 May 19 06:41:49.428162 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 463/930] 10.222.0.65 () {60 vars in 1261 bytes} [Thu May 19 06:41:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2040039853 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 06:41:51.319776 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d19b79d8-49cb-4ede-a46b-3b0dc5b0a897 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:51.320266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d19b79d8-49cb-4ede-a46b-3b0dc5b0a897 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:51.327627 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d19b79d8-49cb-4ede-a46b-3b0dc5b0a897 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:51.328070 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d19b79d8-49cb-4ede-a46b-3b0dc5b0a897 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:51.328847 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d19b79d8-49cb-4ede-a46b-3b0dc5b0a897 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:51.329301 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d19b79d8-49cb-4ede-a46b-3b0dc5b0a897 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:51.343647 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-d19b79d8-49cb-4ede-a46b-3b0dc5b0a897 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] HTTP exception thrown: Instance cbdc43c2-f91a-4d38-ba69-9ca674473c29 could not be found. May 19 06:41:51.345227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d19b79d8-49cb-4ede-a46b-3b0dc5b0a897 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Request method failure captured: May 19 06:41:51.345227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: request: DELETE /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 HTTP/1.1 May 19 06:41:51.345227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept: application/json May 19 06:41:51.345227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity May 19 06:41:51.345227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Connection: close May 19 06:41:51.345227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Length: 0 May 19 06:41:51.345227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Type: application/json May 19 06:41:51.345227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Host: 10.222.0.65 May 19 06:41:51.345227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None May 19 06:41:51.345227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 May 19 06:41:51.345227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiheWD6cQhjZG-XwixYSXIkUEMkJ-sOE63Sa9pijFv9NBliLzJlR7V-ObuT2TtIZVIefICt7JgdZX4HH0xGivixZxbQmE2Hv2v4q2Q-vgaVY7mFxaKWhSBXCUQTru8LLX4DjdP7YGJWOJAJhTcdsulI-9frBxJlpkQotDIqllulRNMLs0 May 19 06:41:51.345227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Id: None May 19 06:41:51.345227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Name: None May 19 06:41:51.345227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed May 19 06:41:51.345227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True May 19 06:41:51.345227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Openstack-Nova-Api-Version: 2.20 May 19 06:41:51.345227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default May 19 06:41:51.345227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default May 19 06:41:51.345227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Id: e21ed8d40dab40828a1fc685ca63ad92 May 19 06:41:51.345227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-125467305 May 19 06:41:51.345227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Role: reader,member May 19 06:41:51.345227 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Roles: reader,member May 19 06:41:51.346974 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e21ed8d40dab40828a1fc685ca63ad92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e21ed8d40dab40828a1fc685ca63ad92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e21ed8d40dab40828a1fc685ca63ad92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e21ed8d40dab40828a1fc685ca63ad92", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:41:51.346974 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-AttachVolumeShelveTestJSON-125467305 May 19 06:41:51.346974 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Id: e21ed8d40dab40828a1fc685ca63ad92 May 19 06:41:51.346974 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-125467305 May 19 06:41:51.346974 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User: tempest-AttachVolumeShelveTestJSON-125467305-project May 19 06:41:51.346974 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default May 19 06:41:51.346974 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default May 19 06:41:51.346974 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Id: 3a8abbf889e149f5be25ecddb22384a5 May 19 06:41:51.346974 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-AttachVolumeShelveTestJSON-125467305-project May 19 06:41:51.346974 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: method: > May 19 06:41:51.346974 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: exception: Instance cbdc43c2-f91a-4d38-ba69-9ca674473c29 could not be found. May 19 06:41:51.346974 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: action_args: {'id': 'cbdc43c2-f91a-4d38-ba69-9ca674473c29'} May 19 06:41:51.347931 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:41:51.347931 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:41:51.347931 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:41:51.347931 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:41:51.347931 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:41:51.347931 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:41:51.347931 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:41:51.347931 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:41:51.347931 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:41:51.347931 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:41:51.347931 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbdc43c2-f91a-4d38-ba69-9ca674473c29 could not be found. May 19 06:41:51.347931 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:41:51.347931 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:41:51.347931 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:41:51.347931 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:41:51.347931 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:41:51.347931 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:41:51.347931 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:41:51.347931 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:41:51.347931 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:41:51.349491 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:41:51.349491 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 06:41:51.349491 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 06:41:51.349491 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 06:41:51.349491 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 06:41:51.349491 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:41:51.349491 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:41:51.349491 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:41:51.349491 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:41:51.349491 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbdc43c2-f91a-4d38-ba69-9ca674473c29 could not be found. May 19 06:41:51.349491 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:41:51.349491 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:41:51.349491 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:41:51.349491 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:41:51.349491 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:41:51.349491 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:41:51.349491 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:41:51.349491 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:41:51.349491 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbdc43c2-f91a-4d38-ba69-9ca674473c29 could not be found. May 19 06:41:51.349491 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:41:51.351135 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d19b79d8-49cb-4ede-a46b-3b0dc5b0a897 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Returning 404 to user: Instance cbdc43c2-f91a-4d38-ba69-9ca674473c29 could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:41:51.351135 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d19b79d8-49cb-4ede-a46b-3b0dc5b0a897 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "DELETE /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 404 len: 111 microversion: 2.20 time: 0.030717 May 19 06:41:51.351135 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 468/931] 10.222.0.65 () {60 vars in 1279 bytes} [Thu May 19 06:41:51 2022] DELETE /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 06:41:51.357190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-005c0a52-af07-4128-a905-a20b8a857135 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:51.357830 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-005c0a52-af07-4128-a905-a20b8a857135 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: cbdc43c2-f91a-4d38-ba69-9ca674473c29] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:51.364420 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-005c0a52-af07-4128-a905-a20b8a857135 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:51.364869 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-005c0a52-af07-4128-a905-a20b8a857135 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:51.365713 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-005c0a52-af07-4128-a905-a20b8a857135 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:51.366153 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-005c0a52-af07-4128-a905-a20b8a857135 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:51.379241 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-005c0a52-af07-4128-a905-a20b8a857135 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] HTTP exception thrown: Instance cbdc43c2-f91a-4d38-ba69-9ca674473c29 could not be found. May 19 06:41:51.380886 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-005c0a52-af07-4128-a905-a20b8a857135 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Request method failure captured: May 19 06:41:51.380886 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 HTTP/1.1 May 19 06:41:51.380886 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:41:51.380886 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:41:51.380886 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:41:51.380886 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 0 May 19 06:41:51.380886 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:41:51.380886 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:41:51.380886 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:41:51.380886 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:41:51.380886 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheWD6cQhjZG-XwixYSXIkUEMkJ-sOE63Sa9pijFv9NBliLzJlR7V-ObuT2TtIZVIefICt7JgdZX4HH0xGivixZxbQmE2Hv2v4q2Q-vgaVY7mFxaKWhSBXCUQTru8LLX4DjdP7YGJWOJAJhTcdsulI-9frBxJlpkQotDIqllulRNMLs0 May 19 06:41:51.380886 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:41:51.380886 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:41:51.380886 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:41:51.380886 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:41:51.380886 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Openstack-Nova-Api-Version: 2.20 May 19 06:41:51.380886 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:41:51.380886 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:41:51.380886 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: e21ed8d40dab40828a1fc685ca63ad92 May 19 06:41:51.380886 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-125467305 May 19 06:41:51.380886 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:41:51.380886 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:41:51.382594 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e21ed8d40dab40828a1fc685ca63ad92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e21ed8d40dab40828a1fc685ca63ad92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e21ed8d40dab40828a1fc685ca63ad92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e21ed8d40dab40828a1fc685ca63ad92", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:41:51.382594 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-AttachVolumeShelveTestJSON-125467305 May 19 06:41:51.382594 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: e21ed8d40dab40828a1fc685ca63ad92 May 19 06:41:51.382594 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-125467305 May 19 06:41:51.382594 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-AttachVolumeShelveTestJSON-125467305-project May 19 06:41:51.382594 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:41:51.382594 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:41:51.382594 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: 3a8abbf889e149f5be25ecddb22384a5 May 19 06:41:51.382594 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-AttachVolumeShelveTestJSON-125467305-project May 19 06:41:51.382594 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: > May 19 06:41:51.382594 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Instance cbdc43c2-f91a-4d38-ba69-9ca674473c29 could not be found. May 19 06:41:51.382594 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'id': 'cbdc43c2-f91a-4d38-ba69-9ca674473c29'} May 19 06:41:51.383991 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:41:51.383991 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:41:51.383991 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:41:51.383991 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:41:51.383991 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:41:51.383991 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:41:51.383991 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:41:51.383991 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:41:51.383991 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:41:51.383991 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:41:51.383991 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbdc43c2-f91a-4d38-ba69-9ca674473c29 could not be found. May 19 06:41:51.383991 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:41:51.383991 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:41:51.383991 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:41:51.383991 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:41:51.383991 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:41:51.383991 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:41:51.383991 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:41:51.383991 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:41:51.383991 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:41:51.385570 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:41:51.385570 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:41:51.385570 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:41:51.385570 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:41:51.385570 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:41:51.385570 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:41:51.385570 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:41:51.385570 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbdc43c2-f91a-4d38-ba69-9ca674473c29 could not be found. May 19 06:41:51.385570 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:41:51.385570 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:41:51.385570 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:41:51.385570 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:41:51.385570 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:41:51.385570 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:41:51.385570 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:41:51.385570 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:41:51.385570 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbdc43c2-f91a-4d38-ba69-9ca674473c29 could not be found. May 19 06:41:51.385570 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:41:51.386935 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-005c0a52-af07-4128-a905-a20b8a857135 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Returning 404 to user: Instance cbdc43c2-f91a-4d38-ba69-9ca674473c29 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:41:51.386935 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-005c0a52-af07-4128-a905-a20b8a857135 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29" status: 404 len: 111 microversion: 2.20 time: 0.029732 May 19 06:41:51.386935 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 464/932] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:41:51 2022] GET /compute/v2.1/servers/cbdc43c2-f91a-4d38-ba69-9ca674473c29 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 06:41:52.515776 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e976f214-73af-45a0-9897-5f4b88a7a533 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:52.516293 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e976f214-73af-45a0-9897-5f4b88a7a533 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:52.522810 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e976f214-73af-45a0-9897-5f4b88a7a533 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:52.523257 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e976f214-73af-45a0-9897-5f4b88a7a533 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:52.524014 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e976f214-73af-45a0-9897-5f4b88a7a533 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:52.525077 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e976f214-73af-45a0-9897-5f4b88a7a533 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:52.539605 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-e976f214-73af-45a0-9897-5f4b88a7a533 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] HTTP exception thrown: Instance 06323e6f-7b35-407f-aecf-5435fa013454 could not be found. May 19 06:41:52.541535 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e976f214-73af-45a0-9897-5f4b88a7a533 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Request method failure captured: May 19 06:41:52.541535 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: request: DELETE /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 HTTP/1.1 May 19 06:41:52.541535 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept: application/json May 19 06:41:52.541535 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity May 19 06:41:52.541535 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Connection: close May 19 06:41:52.541535 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Length: 0 May 19 06:41:52.541535 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Type: application/json May 19 06:41:52.541535 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Host: 10.222.0.65 May 19 06:41:52.541535 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None May 19 06:41:52.541535 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 May 19 06:41:52.541535 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiheWD6cQhjZG-XwixYSXIkUEMkJ-sOE63Sa9pijFv9NBliLzJlR7V-ObuT2TtIZVIefICt7JgdZX4HH0xGivixZxbQmE2Hv2v4q2Q-vgaVY7mFxaKWhSBXCUQTru8LLX4DjdP7YGJWOJAJhTcdsulI-9frBxJlpkQotDIqllulRNMLs0 May 19 06:41:52.541535 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Id: None May 19 06:41:52.541535 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Name: None May 19 06:41:52.541535 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed May 19 06:41:52.541535 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True May 19 06:41:52.541535 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Openstack-Nova-Api-Version: 2.20 May 19 06:41:52.541535 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default May 19 06:41:52.541535 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default May 19 06:41:52.541535 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Id: e21ed8d40dab40828a1fc685ca63ad92 May 19 06:41:52.541535 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-125467305 May 19 06:41:52.541535 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Role: reader,member May 19 06:41:52.541535 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Roles: reader,member May 19 06:41:52.543228 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e21ed8d40dab40828a1fc685ca63ad92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e21ed8d40dab40828a1fc685ca63ad92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e21ed8d40dab40828a1fc685ca63ad92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e21ed8d40dab40828a1fc685ca63ad92", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:41:52.543228 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-AttachVolumeShelveTestJSON-125467305 May 19 06:41:52.543228 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Id: e21ed8d40dab40828a1fc685ca63ad92 May 19 06:41:52.543228 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-125467305 May 19 06:41:52.543228 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User: tempest-AttachVolumeShelveTestJSON-125467305-project May 19 06:41:52.543228 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default May 19 06:41:52.543228 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default May 19 06:41:52.543228 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Id: 3a8abbf889e149f5be25ecddb22384a5 May 19 06:41:52.543228 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-AttachVolumeShelveTestJSON-125467305-project May 19 06:41:52.543228 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: method: > May 19 06:41:52.543228 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: exception: Instance 06323e6f-7b35-407f-aecf-5435fa013454 could not be found. May 19 06:41:52.543228 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: action_args: {'id': '06323e6f-7b35-407f-aecf-5435fa013454'} May 19 06:41:52.544339 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:41:52.544339 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:41:52.544339 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:41:52.544339 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:41:52.544339 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:41:52.544339 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:41:52.544339 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:41:52.544339 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:41:52.544339 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:41:52.544339 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:41:52.544339 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06323e6f-7b35-407f-aecf-5435fa013454 could not be found. May 19 06:41:52.544339 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:41:52.544339 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:41:52.544339 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:41:52.544339 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:41:52.544339 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:41:52.544339 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:41:52.544339 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:41:52.544339 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:41:52.544339 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:41:52.545908 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:41:52.545908 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 06:41:52.545908 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 06:41:52.545908 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 06:41:52.545908 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 06:41:52.545908 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:41:52.545908 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:41:52.545908 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:41:52.545908 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:41:52.545908 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06323e6f-7b35-407f-aecf-5435fa013454 could not be found. May 19 06:41:52.545908 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:41:52.545908 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:41:52.545908 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:41:52.545908 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:41:52.545908 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:41:52.545908 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:41:52.545908 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:41:52.545908 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:41:52.545908 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06323e6f-7b35-407f-aecf-5435fa013454 could not be found. May 19 06:41:52.545908 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:41:52.547780 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e976f214-73af-45a0-9897-5f4b88a7a533 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Returning 404 to user: Instance 06323e6f-7b35-407f-aecf-5435fa013454 could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:41:52.547780 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e976f214-73af-45a0-9897-5f4b88a7a533 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "DELETE /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 404 len: 111 microversion: 2.20 time: 0.031088 May 19 06:41:52.547780 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 469/933] 10.222.0.65 () {60 vars in 1279 bytes} [Thu May 19 06:41:52 2022] DELETE /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 06:41:52.552525 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e071a4a4-1e33-4471-a28f-9ff11489a250 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:41:52.553138 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e071a4a4-1e33-4471-a28f-9ff11489a250 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] [instance: 06323e6f-7b35-407f-aecf-5435fa013454] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:41:52.559758 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e071a4a4-1e33-4471-a28f-9ff11489a250 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:52.560206 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e071a4a4-1e33-4471-a28f-9ff11489a250 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:52.560964 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e071a4a4-1e33-4471-a28f-9ff11489a250 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:41:52.561444 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e071a4a4-1e33-4471-a28f-9ff11489a250 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:41:52.574536 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-e071a4a4-1e33-4471-a28f-9ff11489a250 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] HTTP exception thrown: Instance 06323e6f-7b35-407f-aecf-5435fa013454 could not be found. May 19 06:41:52.576056 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e071a4a4-1e33-4471-a28f-9ff11489a250 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Request method failure captured: May 19 06:41:52.576056 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 HTTP/1.1 May 19 06:41:52.576056 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:41:52.576056 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:41:52.576056 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:41:52.576056 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 0 May 19 06:41:52.576056 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:41:52.576056 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:41:52.576056 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:41:52.576056 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:41:52.576056 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheWD6cQhjZG-XwixYSXIkUEMkJ-sOE63Sa9pijFv9NBliLzJlR7V-ObuT2TtIZVIefICt7JgdZX4HH0xGivixZxbQmE2Hv2v4q2Q-vgaVY7mFxaKWhSBXCUQTru8LLX4DjdP7YGJWOJAJhTcdsulI-9frBxJlpkQotDIqllulRNMLs0 May 19 06:41:52.576056 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:41:52.576056 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:41:52.576056 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:41:52.576056 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:41:52.576056 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Openstack-Nova-Api-Version: 2.20 May 19 06:41:52.576056 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:41:52.576056 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:41:52.576056 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: e21ed8d40dab40828a1fc685ca63ad92 May 19 06:41:52.576056 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-125467305 May 19 06:41:52.576056 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:41:52.576056 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:41:52.577813 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e21ed8d40dab40828a1fc685ca63ad92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e21ed8d40dab40828a1fc685ca63ad92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e21ed8d40dab40828a1fc685ca63ad92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e21ed8d40dab40828a1fc685ca63ad92", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:41:52.577813 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-AttachVolumeShelveTestJSON-125467305 May 19 06:41:52.577813 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: e21ed8d40dab40828a1fc685ca63ad92 May 19 06:41:52.577813 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-125467305 May 19 06:41:52.577813 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-AttachVolumeShelveTestJSON-125467305-project May 19 06:41:52.577813 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:41:52.577813 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:41:52.577813 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: 3a8abbf889e149f5be25ecddb22384a5 May 19 06:41:52.577813 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-AttachVolumeShelveTestJSON-125467305-project May 19 06:41:52.577813 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: > May 19 06:41:52.577813 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Instance 06323e6f-7b35-407f-aecf-5435fa013454 could not be found. May 19 06:41:52.577813 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'id': '06323e6f-7b35-407f-aecf-5435fa013454'} May 19 06:41:52.582211 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:41:52.582211 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:41:52.582211 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:41:52.582211 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:41:52.582211 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:41:52.582211 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:41:52.582211 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:41:52.582211 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:41:52.582211 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:41:52.582211 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:41:52.582211 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06323e6f-7b35-407f-aecf-5435fa013454 could not be found. May 19 06:41:52.582211 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:41:52.582211 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:41:52.582211 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:41:52.582211 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:41:52.582211 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:41:52.582211 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:41:52.582211 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:41:52.582211 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:41:52.582211 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:41:52.584199 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:41:52.584199 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:41:52.584199 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:41:52.584199 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:41:52.584199 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:41:52.584199 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:41:52.584199 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:41:52.584199 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06323e6f-7b35-407f-aecf-5435fa013454 could not be found. May 19 06:41:52.584199 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:41:52.584199 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:41:52.584199 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:41:52.584199 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:41:52.584199 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:41:52.584199 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:41:52.584199 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:41:52.584199 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:41:52.584199 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06323e6f-7b35-407f-aecf-5435fa013454 could not be found. May 19 06:41:52.584199 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:41:52.585675 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e071a4a4-1e33-4471-a28f-9ff11489a250 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] Returning 404 to user: Instance 06323e6f-7b35-407f-aecf-5435fa013454 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:41:52.585675 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e071a4a4-1e33-4471-a28f-9ff11489a250 tempest-AttachVolumeShelveTestJSON-125467305 tempest-AttachVolumeShelveTestJSON-125467305-project] 10.222.0.65 "GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454" status: 404 len: 111 microversion: 2.20 time: 0.028724 May 19 06:41:52.585675 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 465/934] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 06:41:52 2022] GET /compute/v2.1/servers/06323e6f-7b35-407f-aecf-5435fa013454 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 06:42:47.557609 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 06:42:47.558768 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Thu May 19 06:42:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 06:43:02.026087 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-512b28af-6d8f-4393-aab3-30c0f18bacf0 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1381249128", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1671934445", "security_groups": [{"name": "tempest-secgroup-smoke-1964986703"}], "block_device_mapping_v2": [{"uuid": "14c9e3fc-10ae-4ab0-94ae-fcfbb753e660", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cf104e4d-072e-4746-a72c-c14fb907651b"}]}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:43:02.050786 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=12 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:43:02.052423 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=20 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:43:02.235284 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.network.neutron [None req-512b28af-6d8f-4393-aab3-30c0f18bacf0 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] validate_networks() for [('cf104e4d-072e-4746-a72c-c14fb907651b', None, None, None, None, None)] {{(pid=117712) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 06:43:03.314254 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-512b28af-6d8f-4393-aab3-30c0f18bacf0 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Flavor limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 06:43:03.316117 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-512b28af-6d8f-4393-aab3-30c0f18bacf0 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Image limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 06:43:03.317539 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-512b28af-6d8f-4393-aab3-30c0f18bacf0 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Flavor pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 06:43:03.318390 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-512b28af-6d8f-4393-aab3-30c0f18bacf0 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Image pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 06:43:03.319020 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-512b28af-6d8f-4393-aab3-30c0f18bacf0 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 06:43:03.331479 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-512b28af-6d8f-4393-aab3-30c0f18bacf0 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:03.332265 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-512b28af-6d8f-4393-aab3-30c0f18bacf0 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:03.333145 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-512b28af-6d8f-4393-aab3-30c0f18bacf0 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:03.333627 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-512b28af-6d8f-4393-aab3-30c0f18bacf0 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:03.352784 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-512b28af-6d8f-4393-aab3-30c0f18bacf0 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Getting quotas for project 318e4e0d9f3a49f69eb3d846539b6b67. Resources: {'ram', 'cores', 'instances'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:43:03.357965 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-512b28af-6d8f-4393-aab3-30c0f18bacf0 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Getting quotas for user c1815cc5a2fd43259c5b53650dbc7603 and project 318e4e0d9f3a49f69eb3d846539b6b67. Resources: {'ram', 'cores', 'instances'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:43:03.438089 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-512b28af-6d8f-4393-aab3-30c0f18bacf0 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Going to run 1 instances... {{(pid=117712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 06:43:03.440192 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-512b28af-6d8f-4393-aab3-30c0f18bacf0 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: abe88117-18ec-43f8-8e35-cf5070b67827] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='14c9e3fc-10ae-4ab0-94ae-fcfbb753e660',volume_size=None,volume_type=None)] {{(pid=117712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 06:43:03.628245 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-512b28af-6d8f-4393-aab3-30c0f18bacf0 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.611277 May 19 06:43:03.629386 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 470/935] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 06:43:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 06:43:03.644441 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:43:03.645716 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:43:03.651538 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b080b762-6ace-4679-bbeb-867be4909f68 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:03.653223 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b080b762-6ace-4679-bbeb-867be4909f68 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: abe88117-18ec-43f8-8e35-cf5070b67827] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:03.796435 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b080b762-6ace-4679-bbeb-867be4909f68 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:03.809492 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b080b762-6ace-4679-bbeb-867be4909f68 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827" status: 200 len: 1095 microversion: 2.1 time: 0.165841 May 19 06:43:03.812468 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 466/936] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:03 2022] GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827 => generated 1095 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:43:04.830035 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c04cf651-97d9-4a77-90b3-f503afda6f20 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:04.831704 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c04cf651-97d9-4a77-90b3-f503afda6f20 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: abe88117-18ec-43f8-8e35-cf5070b67827] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:04.857086 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c04cf651-97d9-4a77-90b3-f503afda6f20 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:04.859198 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c04cf651-97d9-4a77-90b3-f503afda6f20 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:04.860165 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c04cf651-97d9-4a77-90b3-f503afda6f20 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:04.861938 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c04cf651-97d9-4a77-90b3-f503afda6f20 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:04.986011 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c04cf651-97d9-4a77-90b3-f503afda6f20 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:04.994907 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c04cf651-97d9-4a77-90b3-f503afda6f20 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827" status: 200 len: 1211 microversion: 2.1 time: 0.171792 May 19 06:43:04.996604 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 471/937] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:04 2022] GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827 => generated 1211 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:43:06.013864 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e1ba25a2-ab8f-4671-a47a-9584e766d1d7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:06.015701 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e1ba25a2-ab8f-4671-a47a-9584e766d1d7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: abe88117-18ec-43f8-8e35-cf5070b67827] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:06.028452 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e1ba25a2-ab8f-4671-a47a-9584e766d1d7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:06.029243 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e1ba25a2-ab8f-4671-a47a-9584e766d1d7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:06.030248 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e1ba25a2-ab8f-4671-a47a-9584e766d1d7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:06.030868 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e1ba25a2-ab8f-4671-a47a-9584e766d1d7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:06.513138 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e1ba25a2-ab8f-4671-a47a-9584e766d1d7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:06.532764 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e1ba25a2-ab8f-4671-a47a-9584e766d1d7 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827" status: 200 len: 1267 microversion: 2.1 time: 0.512825 May 19 06:43:06.535874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 467/938] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:06 2022] GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827 => generated 1267 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:43:06.953251 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-a850161e-bc49-4f0a-95fd-e5ab58add439 req-736c5ec1-9116-4c0d-8f09-3b750be278d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abe88117-18ec-43f8-8e35-cf5070b67827", "tag": "e30dd969-e227-4861-b1fe-f804ef540a02"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:43:06.991284 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-a850161e-bc49-4f0a-95fd-e5ab58add439 req-736c5ec1-9116-4c0d-8f09-3b750be278d0 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:06.993781 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-a850161e-bc49-4f0a-95fd-e5ab58add439 req-736c5ec1-9116-4c0d-8f09-3b750be278d0 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:07.045763 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-a850161e-bc49-4f0a-95fd-e5ab58add439 req-736c5ec1-9116-4c0d-8f09-3b750be278d0 service nova] Creating event network-changed:e30dd969-e227-4861-b1fe-f804ef540a02 for instance abe88117-18ec-43f8-8e35-cf5070b67827 on hv-cinder-83699 May 19 06:43:07.066669 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-a850161e-bc49-4f0a-95fd-e5ab58add439 req-736c5ec1-9116-4c0d-8f09-3b750be278d0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125580 May 19 06:43:07.067159 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 472/939] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:43:07.551993 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3328f822-9403-4ea9-8295-fe404b11236c tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:07.552598 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-3328f822-9403-4ea9-8295-fe404b11236c tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: abe88117-18ec-43f8-8e35-cf5070b67827] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:07.571165 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3328f822-9403-4ea9-8295-fe404b11236c tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:07.571664 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3328f822-9403-4ea9-8295-fe404b11236c tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:07.572719 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3328f822-9403-4ea9-8295-fe404b11236c tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:07.573158 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3328f822-9403-4ea9-8295-fe404b11236c tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:07.943705 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3328f822-9403-4ea9-8295-fe404b11236c tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:07.954622 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-3328f822-9403-4ea9-8295-fe404b11236c tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827" status: 200 len: 1267 microversion: 2.1 time: 0.405906 May 19 06:43:07.955736 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 468/940] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:07 2022] GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827 => generated 1267 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:43:08.973376 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1929665f-7678-468d-aa76-822c697f84a2 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:08.974663 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1929665f-7678-468d-aa76-822c697f84a2 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: abe88117-18ec-43f8-8e35-cf5070b67827] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:08.985200 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1929665f-7678-468d-aa76-822c697f84a2 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:08.986004 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1929665f-7678-468d-aa76-822c697f84a2 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:08.986987 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1929665f-7678-468d-aa76-822c697f84a2 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:08.987594 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1929665f-7678-468d-aa76-822c697f84a2 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:09.228782 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1929665f-7678-468d-aa76-822c697f84a2 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:09.237673 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1929665f-7678-468d-aa76-822c697f84a2 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827" status: 200 len: 1267 microversion: 2.1 time: 0.269207 May 19 06:43:09.238258 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 473/941] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:08 2022] GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827 => generated 1267 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:43:10.198964 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a42156c9-1d6f-42fa-b486-fa7502a84c82 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Action: 'create', calling method: .version_select at 0x7f9aeb4eac10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1779094856", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6vkA1fju+cGWff/E+gwK3AGYSR+pQX46yGhOnWj+rsjjlk0FELjSEk+VHxZGU44K8Gm7QN+F12dyIG2LNWyuKtBUwewNo8PMVkP1c6v4ZdA4fBU1xI78WVb/bCIBnncw=="}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:43:10.217007 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-a42156c9-1d6f-42fa-b486-fa7502a84c82 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Getting quotas for project 4acaeb032d8e44eb97a4b0a573e7c360. Resources: {'key_pairs'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:43:10.221435 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-a42156c9-1d6f-42fa-b486-fa7502a84c82 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Getting quotas for user 697d433699cc475d91609e010917ca16 and project 4acaeb032d8e44eb97a4b0a573e7c360. Resources: {'key_pairs'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:43:10.244950 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a42156c9-1d6f-42fa-b486-fa7502a84c82 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.225673 May 19 06:43:10.246361 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 469/942] 10.222.0.65 () {60 vars in 1158 bytes} [Thu May 19 06:43:10 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:43:10.254754 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0748f8e6-8105-43b1-8dc7-ee93dc8014a6 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:10.255366 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0748f8e6-8105-43b1-8dc7-ee93dc8014a6 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: abe88117-18ec-43f8-8e35-cf5070b67827] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:10.262778 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0748f8e6-8105-43b1-8dc7-ee93dc8014a6 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:10.263606 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0748f8e6-8105-43b1-8dc7-ee93dc8014a6 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:10.264672 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0748f8e6-8105-43b1-8dc7-ee93dc8014a6 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:10.265115 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0748f8e6-8105-43b1-8dc7-ee93dc8014a6 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:10.438557 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0748f8e6-8105-43b1-8dc7-ee93dc8014a6 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:10.452213 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0748f8e6-8105-43b1-8dc7-ee93dc8014a6 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827" status: 200 len: 1267 microversion: 2.1 time: 0.201465 May 19 06:43:10.455073 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 474/943] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:10 2022] GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827 => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:43:11.471622 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-2593793b-ea73-44a8-b9af-68924ab03a8e tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:11.472253 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-2593793b-ea73-44a8-b9af-68924ab03a8e tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: abe88117-18ec-43f8-8e35-cf5070b67827] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:11.479955 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2593793b-ea73-44a8-b9af-68924ab03a8e tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:11.480399 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2593793b-ea73-44a8-b9af-68924ab03a8e tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:11.481173 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2593793b-ea73-44a8-b9af-68924ab03a8e tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:11.481762 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2593793b-ea73-44a8-b9af-68924ab03a8e tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:11.623161 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2593793b-ea73-44a8-b9af-68924ab03a8e tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:11.630868 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-2593793b-ea73-44a8-b9af-68924ab03a8e tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827" status: 200 len: 1267 microversion: 2.1 time: 0.163844 May 19 06:43:11.631455 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 470/944] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:11 2022] GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:43:12.647976 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-95da3eec-bb6f-490b-811b-f1b4ee5b5013 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:12.648597 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-95da3eec-bb6f-490b-811b-f1b4ee5b5013 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: abe88117-18ec-43f8-8e35-cf5070b67827] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:12.656397 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-95da3eec-bb6f-490b-811b-f1b4ee5b5013 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:12.656844 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-95da3eec-bb6f-490b-811b-f1b4ee5b5013 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:12.657642 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-95da3eec-bb6f-490b-811b-f1b4ee5b5013 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:12.658072 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-95da3eec-bb6f-490b-811b-f1b4ee5b5013 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:12.804858 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-95da3eec-bb6f-490b-811b-f1b4ee5b5013 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:12.818838 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-95da3eec-bb6f-490b-811b-f1b4ee5b5013 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827" status: 200 len: 1267 microversion: 2.1 time: 0.174741 May 19 06:43:12.819498 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 475/945] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:12 2022] GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:43:13.837011 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a95be4dd-9de8-4661-af2f-4ed2f8214dd4 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:13.837657 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a95be4dd-9de8-4661-af2f-4ed2f8214dd4 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: abe88117-18ec-43f8-8e35-cf5070b67827] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:13.862756 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a95be4dd-9de8-4661-af2f-4ed2f8214dd4 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:13.866255 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a95be4dd-9de8-4661-af2f-4ed2f8214dd4 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:13.873703 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a95be4dd-9de8-4661-af2f-4ed2f8214dd4 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:13.874166 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a95be4dd-9de8-4661-af2f-4ed2f8214dd4 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:14.065133 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a95be4dd-9de8-4661-af2f-4ed2f8214dd4 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:14.073466 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a95be4dd-9de8-4661-af2f-4ed2f8214dd4 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827" status: 200 len: 1267 microversion: 2.1 time: 0.241300 May 19 06:43:14.074877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 471/946] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:13 2022] GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827 => generated 1267 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:43:15.092586 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e5360387-72c1-4e7d-8154-4abb99af979f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:15.093199 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e5360387-72c1-4e7d-8154-4abb99af979f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: abe88117-18ec-43f8-8e35-cf5070b67827] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:15.095341 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:43:15.096112 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=6 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:43:15.105160 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e5360387-72c1-4e7d-8154-4abb99af979f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:15.105630 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e5360387-72c1-4e7d-8154-4abb99af979f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:15.106406 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e5360387-72c1-4e7d-8154-4abb99af979f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:15.107444 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e5360387-72c1-4e7d-8154-4abb99af979f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:15.247161 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e5360387-72c1-4e7d-8154-4abb99af979f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:15.255049 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e5360387-72c1-4e7d-8154-4abb99af979f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827" status: 200 len: 1267 microversion: 2.1 time: 0.167340 May 19 06:43:15.255609 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 476/947] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:15 2022] GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:43:16.272112 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-580a09b8-8532-4ac7-b6c7-45e3b5618036 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:16.272782 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-580a09b8-8532-4ac7-b6c7-45e3b5618036 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: abe88117-18ec-43f8-8e35-cf5070b67827] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:16.279407 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-580a09b8-8532-4ac7-b6c7-45e3b5618036 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:16.279858 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-580a09b8-8532-4ac7-b6c7-45e3b5618036 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:16.280845 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-580a09b8-8532-4ac7-b6c7-45e3b5618036 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:16.281378 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-580a09b8-8532-4ac7-b6c7-45e3b5618036 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:16.422113 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-580a09b8-8532-4ac7-b6c7-45e3b5618036 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:16.429596 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-580a09b8-8532-4ac7-b6c7-45e3b5618036 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827" status: 200 len: 1267 microversion: 2.1 time: 0.161520 May 19 06:43:16.430154 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 472/948] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:16 2022] GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:43:17.446498 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-dbdc9bbb-2e2e-4dd3-971f-5a73cce81999 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:17.447125 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-dbdc9bbb-2e2e-4dd3-971f-5a73cce81999 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: abe88117-18ec-43f8-8e35-cf5070b67827] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:17.454605 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dbdc9bbb-2e2e-4dd3-971f-5a73cce81999 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:17.455062 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dbdc9bbb-2e2e-4dd3-971f-5a73cce81999 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:17.455840 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dbdc9bbb-2e2e-4dd3-971f-5a73cce81999 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:17.456278 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dbdc9bbb-2e2e-4dd3-971f-5a73cce81999 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:17.590266 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-dbdc9bbb-2e2e-4dd3-971f-5a73cce81999 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:17.598668 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-dbdc9bbb-2e2e-4dd3-971f-5a73cce81999 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827" status: 200 len: 1267 microversion: 2.1 time: 0.156050 May 19 06:43:17.599250 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 477/949] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:17 2022] GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:43:18.302727 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-77bb7097-397e-4c1c-878c-0b2f784f48c5 req-8cc359fa-80ce-4b2e-8769-aaadec984e32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe88117-18ec-43f8-8e35-cf5070b67827", "name": "network-vif-plugged", "status": "completed", "tag": "e30dd969-e227-4861-b1fe-f804ef540a02"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:43:18.310986 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-77bb7097-397e-4c1c-878c-0b2f784f48c5 req-8cc359fa-80ce-4b2e-8769-aaadec984e32 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:18.312166 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-77bb7097-397e-4c1c-878c-0b2f784f48c5 req-8cc359fa-80ce-4b2e-8769-aaadec984e32 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:18.323584 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-77bb7097-397e-4c1c-878c-0b2f784f48c5 req-8cc359fa-80ce-4b2e-8769-aaadec984e32 service nova] Creating event network-vif-plugged:e30dd969-e227-4861-b1fe-f804ef540a02 for instance abe88117-18ec-43f8-8e35-cf5070b67827 on hv-cinder-83699 May 19 06:43:18.328956 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-77bb7097-397e-4c1c-878c-0b2f784f48c5 req-8cc359fa-80ce-4b2e-8769-aaadec984e32 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095669 May 19 06:43:18.329580 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 473/950] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:43:18.615781 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-cdea8a27-c81c-45f6-a1d0-5b3b517cdeef tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:18.616972 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-cdea8a27-c81c-45f6-a1d0-5b3b517cdeef tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: abe88117-18ec-43f8-8e35-cf5070b67827] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:18.623724 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cdea8a27-c81c-45f6-a1d0-5b3b517cdeef tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:18.624167 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cdea8a27-c81c-45f6-a1d0-5b3b517cdeef tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:18.625470 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cdea8a27-c81c-45f6-a1d0-5b3b517cdeef tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:18.625896 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cdea8a27-c81c-45f6-a1d0-5b3b517cdeef tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:18.768816 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-cdea8a27-c81c-45f6-a1d0-5b3b517cdeef tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:18.777466 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-cdea8a27-c81c-45f6-a1d0-5b3b517cdeef tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827" status: 200 len: 1267 microversion: 2.1 time: 0.165380 May 19 06:43:18.778066 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 478/951] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:18 2022] GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:43:19.796350 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-eae17418-177b-475c-a221-700120788414 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:19.797050 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-eae17418-177b-475c-a221-700120788414 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: abe88117-18ec-43f8-8e35-cf5070b67827] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:19.804026 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eae17418-177b-475c-a221-700120788414 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:19.804531 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eae17418-177b-475c-a221-700120788414 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:19.805662 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eae17418-177b-475c-a221-700120788414 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:19.806148 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eae17418-177b-475c-a221-700120788414 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:19.946719 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-eae17418-177b-475c-a221-700120788414 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:19.956469 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-eae17418-177b-475c-a221-700120788414 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827" status: 200 len: 1267 microversion: 2.1 time: 0.164505 May 19 06:43:19.957090 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 474/952] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:19 2022] GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:43:20.973990 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-bac0093b-6224-42a0-ab20-29b83978a6c6 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:20.974540 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-bac0093b-6224-42a0-ab20-29b83978a6c6 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: abe88117-18ec-43f8-8e35-cf5070b67827] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:20.980984 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bac0093b-6224-42a0-ab20-29b83978a6c6 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:20.981467 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bac0093b-6224-42a0-ab20-29b83978a6c6 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:20.982222 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bac0093b-6224-42a0-ab20-29b83978a6c6 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:20.982651 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bac0093b-6224-42a0-ab20-29b83978a6c6 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:21.129359 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-bac0093b-6224-42a0-ab20-29b83978a6c6 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:21.138236 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-bac0093b-6224-42a0-ab20-29b83978a6c6 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827" status: 200 len: 1454 microversion: 2.1 time: 0.168921 May 19 06:43:21.138797 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 479/953] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:20 2022] GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827 => generated 1454 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:43:21.153815 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8b6f3df3-743d-4af5-a816-493c6425c60f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:21.154428 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8b6f3df3-743d-4af5-a816-493c6425c60f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: abe88117-18ec-43f8-8e35-cf5070b67827] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:21.156342 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=6 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:43:21.163008 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8b6f3df3-743d-4af5-a816-493c6425c60f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:21.163453 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8b6f3df3-743d-4af5-a816-493c6425c60f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:21.164206 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8b6f3df3-743d-4af5-a816-493c6425c60f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:21.164719 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8b6f3df3-743d-4af5-a816-493c6425c60f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:21.304332 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-8b6f3df3-743d-4af5-a816-493c6425c60f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:21.311838 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8b6f3df3-743d-4af5-a816-493c6425c60f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827" status: 200 len: 1454 microversion: 2.1 time: 0.161814 May 19 06:43:21.312398 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 475/954] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:21 2022] GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827 => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:43:23.152540 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-ea2e7cd9-c117-42f0-8c1a-c68a9575f823 req-44dcc0bf-f0e2-4d83-b0c5-4be7390f5808 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abe88117-18ec-43f8-8e35-cf5070b67827", "tag": "e30dd969-e227-4861-b1fe-f804ef540a02"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:43:23.161516 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-ea2e7cd9-c117-42f0-8c1a-c68a9575f823 req-44dcc0bf-f0e2-4d83-b0c5-4be7390f5808 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:23.161957 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-ea2e7cd9-c117-42f0-8c1a-c68a9575f823 req-44dcc0bf-f0e2-4d83-b0c5-4be7390f5808 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:23.172826 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-ea2e7cd9-c117-42f0-8c1a-c68a9575f823 req-44dcc0bf-f0e2-4d83-b0c5-4be7390f5808 service nova] Creating event network-changed:e30dd969-e227-4861-b1fe-f804ef540a02 for instance abe88117-18ec-43f8-8e35-cf5070b67827 on hv-cinder-83699 May 19 06:43:23.179280 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-ea2e7cd9-c117-42f0-8c1a-c68a9575f823 req-44dcc0bf-f0e2-4d83-b0c5-4be7390f5808 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029663 May 19 06:43:23.179280 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 480/955] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:43:25.504800 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-4adef543-6f32-449f-b06e-726ba9f556ef tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1711067577", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1779094856", "security_groups": [{"name": "tempest-secgroup-smoke-591794991"}], "networks": [{"uuid": "867c2200-fd03-4161-8363-f51839743ece"}], "block_device_mapping_v2": [{"uuid": "03b77463-2142-49c7-ac0f-6353e886bd23", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:43:25.616674 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.network.neutron [None req-4adef543-6f32-449f-b06e-726ba9f556ef tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] validate_networks() for [('867c2200-fd03-4161-8363-f51839743ece', None, None, None, None, None)] {{(pid=117711) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 06:43:25.989560 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-4adef543-6f32-449f-b06e-726ba9f556ef tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Flavor limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 06:43:25.989777 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-4adef543-6f32-449f-b06e-726ba9f556ef tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Image limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 06:43:25.990195 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-4adef543-6f32-449f-b06e-726ba9f556ef tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Flavor pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 06:43:25.990641 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-4adef543-6f32-449f-b06e-726ba9f556ef tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Image pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 06:43:25.991057 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-4adef543-6f32-449f-b06e-726ba9f556ef tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 06:43:26.001126 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4adef543-6f32-449f-b06e-726ba9f556ef tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:26.001860 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4adef543-6f32-449f-b06e-726ba9f556ef tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:26.002666 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4adef543-6f32-449f-b06e-726ba9f556ef tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:26.003104 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4adef543-6f32-449f-b06e-726ba9f556ef tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:26.021237 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-4adef543-6f32-449f-b06e-726ba9f556ef tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Getting quotas for project 4acaeb032d8e44eb97a4b0a573e7c360. Resources: {'ram', 'cores', 'instances'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:43:26.025272 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-4adef543-6f32-449f-b06e-726ba9f556ef tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Getting quotas for user 697d433699cc475d91609e010917ca16 and project 4acaeb032d8e44eb97a4b0a573e7c360. Resources: {'ram', 'cores', 'instances'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:43:26.086184 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-4adef543-6f32-449f-b06e-726ba9f556ef tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Going to run 1 instances... {{(pid=117711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 06:43:26.088432 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-4adef543-6f32-449f-b06e-726ba9f556ef tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='03b77463-2142-49c7-ac0f-6353e886bd23',volume_size=None,volume_type=None)] {{(pid=117711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 06:43:26.218462 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-4adef543-6f32-449f-b06e-726ba9f556ef tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.718229 May 19 06:43:26.219979 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 476/956] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 06:43:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 06:43:26.230886 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b29b7e0f-de59-4aff-9436-dfbbb9f61388 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:26.231711 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b29b7e0f-de59-4aff-9436-dfbbb9f61388 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:26.291803 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b29b7e0f-de59-4aff-9436-dfbbb9f61388 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:26.301426 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b29b7e0f-de59-4aff-9436-dfbbb9f61388 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1089 microversion: 2.1 time: 0.074657 May 19 06:43:26.301866 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 481/957] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:26 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1089 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:43:27.319457 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a0402c1a-90a9-4264-b292-5a90aa78edd3 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:27.320130 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a0402c1a-90a9-4264-b292-5a90aa78edd3 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:27.326690 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a0402c1a-90a9-4264-b292-5a90aa78edd3 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:27.327138 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a0402c1a-90a9-4264-b292-5a90aa78edd3 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:27.327907 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a0402c1a-90a9-4264-b292-5a90aa78edd3 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:27.328894 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a0402c1a-90a9-4264-b292-5a90aa78edd3 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:27.406175 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a0402c1a-90a9-4264-b292-5a90aa78edd3 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:27.414443 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a0402c1a-90a9-4264-b292-5a90aa78edd3 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1205 microversion: 2.1 time: 0.099473 May 19 06:43:27.415049 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 477/958] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:27 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1205 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:43:28.434818 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f7420176-2db8-4ecd-b712-2a38733ea630 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:28.435850 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f7420176-2db8-4ecd-b712-2a38733ea630 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:28.445188 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f7420176-2db8-4ecd-b712-2a38733ea630 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:28.445664 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f7420176-2db8-4ecd-b712-2a38733ea630 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:28.446433 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f7420176-2db8-4ecd-b712-2a38733ea630 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:28.446893 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f7420176-2db8-4ecd-b712-2a38733ea630 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:28.576091 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-f62bfdb7-1733-4b1d-8d9f-aeaa70d87758 req-be8a1cdf-9b99-4916-a18a-7aca773c145f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d3432db-453c-433c-8644-7aef9960fb7b", "tag": "96bc5f89-9dca-4662-8882-eed7169c3f63"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:43:28.585479 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-f62bfdb7-1733-4b1d-8d9f-aeaa70d87758 req-be8a1cdf-9b99-4916-a18a-7aca773c145f service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:28.593102 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-f62bfdb7-1733-4b1d-8d9f-aeaa70d87758 req-be8a1cdf-9b99-4916-a18a-7aca773c145f service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:28.605651 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-f62bfdb7-1733-4b1d-8d9f-aeaa70d87758 req-be8a1cdf-9b99-4916-a18a-7aca773c145f service nova] Creating event network-changed:96bc5f89-9dca-4662-8882-eed7169c3f63 for instance 6d3432db-453c-433c-8644-7aef9960fb7b on hv-cinder-83699 May 19 06:43:28.608062 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f7420176-2db8-4ecd-b712-2a38733ea630 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:28.612106 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-f62bfdb7-1733-4b1d-8d9f-aeaa70d87758 req-be8a1cdf-9b99-4916-a18a-7aca773c145f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039506 May 19 06:43:28.612925 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 478/959] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:43:28.618488 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f7420176-2db8-4ecd-b712-2a38733ea630 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1260 microversion: 2.1 time: 0.189336 May 19 06:43:28.619064 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 482/960] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:28 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1260 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:43:29.637311 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d39c5537-84ac-4f4f-9861-925a7d92e3d1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:29.638032 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d39c5537-84ac-4f4f-9861-925a7d92e3d1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:29.645157 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d39c5537-84ac-4f4f-9861-925a7d92e3d1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:29.645638 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d39c5537-84ac-4f4f-9861-925a7d92e3d1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:29.646412 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d39c5537-84ac-4f4f-9861-925a7d92e3d1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:29.646848 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d39c5537-84ac-4f4f-9861-925a7d92e3d1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:29.777980 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d39c5537-84ac-4f4f-9861-925a7d92e3d1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:29.786449 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d39c5537-84ac-4f4f-9861-925a7d92e3d1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1260 microversion: 2.1 time: 0.154096 May 19 06:43:29.787029 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 479/961] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:29 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:43:30.803707 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-bbf125eb-4a5a-4ddc-b37c-a032bbacb380 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:30.804314 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-bbf125eb-4a5a-4ddc-b37c-a032bbacb380 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:30.810744 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bbf125eb-4a5a-4ddc-b37c-a032bbacb380 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:30.811181 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bbf125eb-4a5a-4ddc-b37c-a032bbacb380 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:30.811938 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bbf125eb-4a5a-4ddc-b37c-a032bbacb380 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:30.812365 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bbf125eb-4a5a-4ddc-b37c-a032bbacb380 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:30.940951 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-bbf125eb-4a5a-4ddc-b37c-a032bbacb380 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:30.948434 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-bbf125eb-4a5a-4ddc-b37c-a032bbacb380 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1260 microversion: 2.1 time: 0.148601 May 19 06:43:30.948964 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 483/962] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:30 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:43:31.964909 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-57630937-7469-4a16-ba38-24299867f18b tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:31.965533 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-57630937-7469-4a16-ba38-24299867f18b tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:31.972583 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-57630937-7469-4a16-ba38-24299867f18b tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:31.973027 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-57630937-7469-4a16-ba38-24299867f18b tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:31.973802 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-57630937-7469-4a16-ba38-24299867f18b tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:31.974229 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-57630937-7469-4a16-ba38-24299867f18b tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:32.105697 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-57630937-7469-4a16-ba38-24299867f18b tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:32.113710 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-57630937-7469-4a16-ba38-24299867f18b tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1260 microversion: 2.1 time: 0.152617 May 19 06:43:32.114272 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 480/963] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:31 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:43:33.131140 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-fda2b0b9-ea04-4f18-b4fa-33f6e64046a8 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:33.131726 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-fda2b0b9-ea04-4f18-b4fa-33f6e64046a8 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:33.134115 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:43:33.139402 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fda2b0b9-ea04-4f18-b4fa-33f6e64046a8 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:33.139843 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fda2b0b9-ea04-4f18-b4fa-33f6e64046a8 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:33.140594 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fda2b0b9-ea04-4f18-b4fa-33f6e64046a8 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:33.141875 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fda2b0b9-ea04-4f18-b4fa-33f6e64046a8 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:33.145356 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=67 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:43:33.280010 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-fda2b0b9-ea04-4f18-b4fa-33f6e64046a8 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:33.287905 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-fda2b0b9-ea04-4f18-b4fa-33f6e64046a8 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1260 microversion: 2.1 time: 0.160695 May 19 06:43:33.288477 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 484/964] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:33 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:43:34.305079 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-4561d383-884c-4b00-9fc1-43a461f7c22f tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:34.305720 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-4561d383-884c-4b00-9fc1-43a461f7c22f tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:34.308089 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:43:34.313955 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4561d383-884c-4b00-9fc1-43a461f7c22f tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:34.314397 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4561d383-884c-4b00-9fc1-43a461f7c22f tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:34.315150 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4561d383-884c-4b00-9fc1-43a461f7c22f tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:34.315578 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4561d383-884c-4b00-9fc1-43a461f7c22f tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:34.318937 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=67 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:43:34.448112 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4561d383-884c-4b00-9fc1-43a461f7c22f tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:34.456289 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-4561d383-884c-4b00-9fc1-43a461f7c22f tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1260 microversion: 2.1 time: 0.155068 May 19 06:43:34.456850 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 481/965] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:34 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:43:35.473363 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f4b056a8-0ce5-4521-bfc9-3e05d23cda33 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:35.474175 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f4b056a8-0ce5-4521-bfc9-3e05d23cda33 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:35.480893 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f4b056a8-0ce5-4521-bfc9-3e05d23cda33 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:35.481370 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f4b056a8-0ce5-4521-bfc9-3e05d23cda33 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:35.482141 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f4b056a8-0ce5-4521-bfc9-3e05d23cda33 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:35.482573 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f4b056a8-0ce5-4521-bfc9-3e05d23cda33 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:35.612093 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f4b056a8-0ce5-4521-bfc9-3e05d23cda33 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:35.619530 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f4b056a8-0ce5-4521-bfc9-3e05d23cda33 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1260 microversion: 2.1 time: 0.150928 May 19 06:43:35.620100 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 485/966] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:35 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:43:36.635942 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a1ee6717-9a8a-4640-b5ef-17aba344e6d6 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:36.636583 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a1ee6717-9a8a-4640-b5ef-17aba344e6d6 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:36.638578 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:43:36.639355 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=6 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:43:36.645854 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a1ee6717-9a8a-4640-b5ef-17aba344e6d6 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:36.646296 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a1ee6717-9a8a-4640-b5ef-17aba344e6d6 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:36.647050 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a1ee6717-9a8a-4640-b5ef-17aba344e6d6 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:36.647478 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a1ee6717-9a8a-4640-b5ef-17aba344e6d6 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:36.776790 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a1ee6717-9a8a-4640-b5ef-17aba344e6d6 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:36.784446 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a1ee6717-9a8a-4640-b5ef-17aba344e6d6 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1260 microversion: 2.1 time: 0.152097 May 19 06:43:36.785010 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 482/967] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:36 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:43:37.801090 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d2fc76ee-6b94-40af-bcc6-5bf3c6c9a5f7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:37.801736 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d2fc76ee-6b94-40af-bcc6-5bf3c6c9a5f7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:37.803635 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:43:37.809412 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d2fc76ee-6b94-40af-bcc6-5bf3c6c9a5f7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:37.809861 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d2fc76ee-6b94-40af-bcc6-5bf3c6c9a5f7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:37.810621 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d2fc76ee-6b94-40af-bcc6-5bf3c6c9a5f7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:37.811061 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d2fc76ee-6b94-40af-bcc6-5bf3c6c9a5f7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:37.943721 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d2fc76ee-6b94-40af-bcc6-5bf3c6c9a5f7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:37.951320 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d2fc76ee-6b94-40af-bcc6-5bf3c6c9a5f7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1260 microversion: 2.1 time: 0.154279 May 19 06:43:37.951889 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 486/968] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:37 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:43:38.968190 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8a8428c9-b193-4dd6-a461-c884ac41dec7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:38.968772 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8a8428c9-b193-4dd6-a461-c884ac41dec7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:38.975609 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8a8428c9-b193-4dd6-a461-c884ac41dec7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:38.976055 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8a8428c9-b193-4dd6-a461-c884ac41dec7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:38.976803 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8a8428c9-b193-4dd6-a461-c884ac41dec7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:38.977228 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8a8428c9-b193-4dd6-a461-c884ac41dec7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:39.113828 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-8a8428c9-b193-4dd6-a461-c884ac41dec7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:39.121407 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8a8428c9-b193-4dd6-a461-c884ac41dec7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1260 microversion: 2.1 time: 0.157082 May 19 06:43:39.121977 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 483/969] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:38 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:43:40.138260 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-5444baf3-135a-4c0d-ad0d-ee3edca8ed3b tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:40.138903 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-5444baf3-135a-4c0d-ad0d-ee3edca8ed3b tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:40.145599 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5444baf3-135a-4c0d-ad0d-ee3edca8ed3b tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:40.146039 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5444baf3-135a-4c0d-ad0d-ee3edca8ed3b tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:40.146926 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5444baf3-135a-4c0d-ad0d-ee3edca8ed3b tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:40.147212 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5444baf3-135a-4c0d-ad0d-ee3edca8ed3b tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:40.288406 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-5444baf3-135a-4c0d-ad0d-ee3edca8ed3b tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:40.295929 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-5444baf3-135a-4c0d-ad0d-ee3edca8ed3b tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1260 microversion: 2.1 time: 0.161522 May 19 06:43:40.296499 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 487/970] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:40 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:43:40.317778 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-3bbca8d6-4805-418c-8755-d347902aa6cd req-7fa37465-19be-4f4a-9398-060092b06c12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d3432db-453c-433c-8644-7aef9960fb7b", "name": "network-vif-plugged", "status": "completed", "tag": "96bc5f89-9dca-4662-8882-eed7169c3f63"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:43:40.327095 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-3bbca8d6-4805-418c-8755-d347902aa6cd req-7fa37465-19be-4f4a-9398-060092b06c12 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:40.327538 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-3bbca8d6-4805-418c-8755-d347902aa6cd req-7fa37465-19be-4f4a-9398-060092b06c12 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:40.339445 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-3bbca8d6-4805-418c-8755-d347902aa6cd req-7fa37465-19be-4f4a-9398-060092b06c12 service nova] Creating event network-vif-plugged:96bc5f89-9dca-4662-8882-eed7169c3f63 for instance 6d3432db-453c-433c-8644-7aef9960fb7b on hv-cinder-83699 May 19 06:43:40.344323 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-3bbca8d6-4805-418c-8755-d347902aa6cd req-7fa37465-19be-4f4a-9398-060092b06c12 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031372 May 19 06:43:40.344910 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 484/971] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:43:41.314557 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7c4c3653-18f3-4583-894f-c9781b6f5025 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:41.315143 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7c4c3653-18f3-4583-894f-c9781b6f5025 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:41.321926 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7c4c3653-18f3-4583-894f-c9781b6f5025 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:41.322383 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7c4c3653-18f3-4583-894f-c9781b6f5025 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:41.323152 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7c4c3653-18f3-4583-894f-c9781b6f5025 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:41.323593 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7c4c3653-18f3-4583-894f-c9781b6f5025 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:41.452285 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7c4c3653-18f3-4583-894f-c9781b6f5025 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:41.460800 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7c4c3653-18f3-4583-894f-c9781b6f5025 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1260 microversion: 2.1 time: 0.150014 May 19 06:43:41.461437 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 488/972] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:41 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:43:42.478457 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e056e59a-8242-4d49-ad98-e8d65a393793 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:42.479154 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e056e59a-8242-4d49-ad98-e8d65a393793 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:42.485312 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e056e59a-8242-4d49-ad98-e8d65a393793 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:42.485763 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e056e59a-8242-4d49-ad98-e8d65a393793 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:42.487273 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e056e59a-8242-4d49-ad98-e8d65a393793 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:42.487713 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e056e59a-8242-4d49-ad98-e8d65a393793 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:42.623439 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e056e59a-8242-4d49-ad98-e8d65a393793 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:42.631114 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e056e59a-8242-4d49-ad98-e8d65a393793 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1445 microversion: 2.1 time: 0.157519 May 19 06:43:42.631683 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 485/973] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:42 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1445 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:43:42.647511 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-5a69123a-1cf5-4654-9fc4-c4dcb084446e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:43:42.648222 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-5a69123a-1cf5-4654-9fc4-c4dcb084446e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:43:42.654900 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5a69123a-1cf5-4654-9fc4-c4dcb084446e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:42.655340 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5a69123a-1cf5-4654-9fc4-c4dcb084446e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:42.656097 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5a69123a-1cf5-4654-9fc4-c4dcb084446e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:42.656528 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5a69123a-1cf5-4654-9fc4-c4dcb084446e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:42.790215 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-5a69123a-1cf5-4654-9fc4-c4dcb084446e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:43:42.797723 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-5a69123a-1cf5-4654-9fc4-c4dcb084446e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1445 microversion: 2.1 time: 0.154053 May 19 06:43:42.798298 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 489/974] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:43:42 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1445 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:43:44.561495 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-83cdb3f2-7b7d-4599-a226-f8ac1d48fcfe req-fe06b96c-944c-4934-8066-216fafbb915a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d3432db-453c-433c-8644-7aef9960fb7b", "tag": "96bc5f89-9dca-4662-8882-eed7169c3f63"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:43:44.569539 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-83cdb3f2-7b7d-4599-a226-f8ac1d48fcfe req-fe06b96c-944c-4934-8066-216fafbb915a service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:43:44.570008 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-83cdb3f2-7b7d-4599-a226-f8ac1d48fcfe req-fe06b96c-944c-4934-8066-216fafbb915a service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:43:44.581641 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-83cdb3f2-7b7d-4599-a226-f8ac1d48fcfe req-fe06b96c-944c-4934-8066-216fafbb915a service nova] Creating event network-changed:96bc5f89-9dca-4662-8882-eed7169c3f63 for instance 6d3432db-453c-433c-8644-7aef9960fb7b on hv-cinder-83699 May 19 06:43:44.586629 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-83cdb3f2-7b7d-4599-a226-f8ac1d48fcfe req-fe06b96c-944c-4934-8066-216fafbb915a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092317 May 19 06:43:44.587170 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 486/975] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:45:03.096933 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a63c4bb7-06c9-4b8a-b23b-f45d6ec8d13f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:45:03.097495 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a63c4bb7-06c9-4b8a-b23b-f45d6ec8d13f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: abe88117-18ec-43f8-8e35-cf5070b67827] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:03.099794 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=11 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:45:03.100452 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=35 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:45:03.105787 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=11 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:45:03.106532 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=27 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:45:03.111030 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-40e0d6f1-bef4-4e29-a5c3-3e997ade6ee4 req-60ea3d8b-aaaa-4d66-8e6c-102ce90a0da5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abe88117-18ec-43f8-8e35-cf5070b67827", "tag": "e30dd969-e227-4861-b1fe-f804ef540a02"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:45:03.120384 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a63c4bb7-06c9-4b8a-b23b-f45d6ec8d13f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:03.120843 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a63c4bb7-06c9-4b8a-b23b-f45d6ec8d13f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:03.121667 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a63c4bb7-06c9-4b8a-b23b-f45d6ec8d13f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:03.122114 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a63c4bb7-06c9-4b8a-b23b-f45d6ec8d13f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:03.130608 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-40e0d6f1-bef4-4e29-a5c3-3e997ade6ee4 req-60ea3d8b-aaaa-4d66-8e6c-102ce90a0da5 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:03.131050 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-40e0d6f1-bef4-4e29-a5c3-3e997ade6ee4 req-60ea3d8b-aaaa-4d66-8e6c-102ce90a0da5 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:03.144485 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-40e0d6f1-bef4-4e29-a5c3-3e997ade6ee4 req-60ea3d8b-aaaa-4d66-8e6c-102ce90a0da5 service nova] Creating event network-changed:e30dd969-e227-4861-b1fe-f804ef540a02 for instance abe88117-18ec-43f8-8e35-cf5070b67827 on hv-cinder-83699 May 19 06:45:03.149820 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a63c4bb7-06c9-4b8a-b23b-f45d6ec8d13f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: abe88117-18ec-43f8-8e35-cf5070b67827] Going to try to terminate instance {{(pid=117712) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 06:45:03.150712 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-40e0d6f1-bef4-4e29-a5c3-3e997ade6ee4 req-60ea3d8b-aaaa-4d66-8e6c-102ce90a0da5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047924 May 19 06:45:03.151520 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 487/976] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:45:03.244130 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a63c4bb7-06c9-4b8a-b23b-f45d6ec8d13f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "DELETE /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827" status: 204 len: 0 microversion: 2.1 time: 0.150518 May 19 06:45:03.245618 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 490/977] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 06:45:03 2022] DELETE /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 06:45:03.254579 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3fd002a2-747d-4cb4-a9ab-c6eca3ed0626 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:45:03.255278 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-3fd002a2-747d-4cb4-a9ab-c6eca3ed0626 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: abe88117-18ec-43f8-8e35-cf5070b67827] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:03.262335 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3fd002a2-747d-4cb4-a9ab-c6eca3ed0626 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:03.262784 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3fd002a2-747d-4cb4-a9ab-c6eca3ed0626 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:03.263705 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3fd002a2-747d-4cb4-a9ab-c6eca3ed0626 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:03.265125 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3fd002a2-747d-4cb4-a9ab-c6eca3ed0626 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:03.693172 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3fd002a2-747d-4cb4-a9ab-c6eca3ed0626 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:45:03.701569 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-3fd002a2-747d-4cb4-a9ab-c6eca3ed0626 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827" status: 200 len: 1579 microversion: 2.1 time: 0.451440 May 19 06:45:03.713368 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 488/978] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:45:03 2022] GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827 => generated 1579 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:45:04.722372 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-04481577-e98a-4070-a951-3f3661491b79 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:45:04.723075 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-04481577-e98a-4070-a951-3f3661491b79 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: abe88117-18ec-43f8-8e35-cf5070b67827] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:04.730130 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-04481577-e98a-4070-a951-3f3661491b79 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:04.730576 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-04481577-e98a-4070-a951-3f3661491b79 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:04.731335 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-04481577-e98a-4070-a951-3f3661491b79 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:04.731773 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-04481577-e98a-4070-a951-3f3661491b79 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:04.877046 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-04481577-e98a-4070-a951-3f3661491b79 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:45:04.886744 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-04481577-e98a-4070-a951-3f3661491b79 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827" status: 200 len: 1579 microversion: 2.1 time: 0.168756 May 19 06:45:04.887670 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 491/979] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:45:04 2022] GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827 => generated 1579 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:45:05.251908 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-eefc99cd-a5f6-4b58-87ad-49f017bada21 req-a9ba74dc-5a3e-4ab9-bbdc-6211a5748ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe88117-18ec-43f8-8e35-cf5070b67827", "name": "network-vif-deleted", "tag": "e30dd969-e227-4861-b1fe-f804ef540a02"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:45:05.264148 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-eefc99cd-a5f6-4b58-87ad-49f017bada21 req-a9ba74dc-5a3e-4ab9-bbdc-6211a5748ce7 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:05.264587 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-eefc99cd-a5f6-4b58-87ad-49f017bada21 req-a9ba74dc-5a3e-4ab9-bbdc-6211a5748ce7 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:05.277246 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-eefc99cd-a5f6-4b58-87ad-49f017bada21 req-a9ba74dc-5a3e-4ab9-bbdc-6211a5748ce7 service nova] Creating event network-vif-deleted:e30dd969-e227-4861-b1fe-f804ef540a02 for instance abe88117-18ec-43f8-8e35-cf5070b67827 on hv-cinder-83699 May 19 06:45:05.282544 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-eefc99cd-a5f6-4b58-87ad-49f017bada21 req-a9ba74dc-5a3e-4ab9-bbdc-6211a5748ce7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034379 May 19 06:45:05.283608 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 489/980] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:45:05.904073 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-5d79105e-b6c2-4a91-8c49-732c8ed080b1 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:45:05.904729 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-5d79105e-b6c2-4a91-8c49-732c8ed080b1 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: abe88117-18ec-43f8-8e35-cf5070b67827] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:05.911469 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5d79105e-b6c2-4a91-8c49-732c8ed080b1 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:05.911914 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5d79105e-b6c2-4a91-8c49-732c8ed080b1 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:05.912706 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5d79105e-b6c2-4a91-8c49-732c8ed080b1 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:05.913137 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5d79105e-b6c2-4a91-8c49-732c8ed080b1 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:05.948343 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5d79105e-b6c2-4a91-8c49-732c8ed080b1 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:05.949049 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5d79105e-b6c2-4a91-8c49-732c8ed080b1 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:05.949636 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-5d79105e-b6c2-4a91-8c49-732c8ed080b1 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lazy-loading 'fault' on Instance uuid abe88117-18ec-43f8-8e35-cf5070b67827 {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:45:05.994972 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-5d79105e-b6c2-4a91-8c49-732c8ed080b1 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:45:06.001831 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-5d79105e-b6c2-4a91-8c49-732c8ed080b1 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827" status: 200 len: 1185 microversion: 2.1 time: 0.101702 May 19 06:45:06.002394 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 492/981] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:45:05 2022] GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827 => generated 1185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:45:07.019912 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5de7f32c-c1a7-4e97-b5a2-fed3161946f5 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:45:07.020688 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5de7f32c-c1a7-4e97-b5a2-fed3161946f5 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: abe88117-18ec-43f8-8e35-cf5070b67827] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:07.028245 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5de7f32c-c1a7-4e97-b5a2-fed3161946f5 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:07.028695 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5de7f32c-c1a7-4e97-b5a2-fed3161946f5 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:07.029488 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5de7f32c-c1a7-4e97-b5a2-fed3161946f5 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:07.029921 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5de7f32c-c1a7-4e97-b5a2-fed3161946f5 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:07.045631 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-5de7f32c-c1a7-4e97-b5a2-fed3161946f5 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] HTTP exception thrown: Instance abe88117-18ec-43f8-8e35-cf5070b67827 could not be found. May 19 06:45:07.047906 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5de7f32c-c1a7-4e97-b5a2-fed3161946f5 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Request method failure captured: May 19 06:45:07.047906 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827 HTTP/1.1 May 19 06:45:07.047906 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:45:07.047906 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:45:07.047906 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:45:07.047906 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 0 May 19 06:45:07.047906 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:45:07.047906 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:45:07.047906 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:45:07.047906 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:45:07.047906 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheXall9X50KtUoZq9BPO9h6Yh2juusugfh8Sq73pNXs2xGe2hGmMnOTHDMSF5p6yV7wLf7AFdaImgynbtulmSQiGJTUoNfpnNILlvmbC7F63-nq-xi2381Q4AbJDMgHzqbWyUKas4MHnelO6PbPnJnZsnt76MOtJLHSOFX7LBJuM6CY May 19 06:45:07.047906 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:45:07.047906 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:45:07.047906 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:45:07.047906 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:45:07.047906 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:45:07.047906 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:45:07.047906 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: 318e4e0d9f3a49f69eb3d846539b6b67 May 19 06:45:07.047906 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-TestVolumeBootPattern-1895289434 May 19 06:45:07.047906 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:45:07.047906 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:45:07.049834 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/318e4e0d9f3a49f69eb3d846539b6b67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/318e4e0d9f3a49f69eb3d846539b6b67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/318e4e0d9f3a49f69eb3d846539b6b67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_318e4e0d9f3a49f69eb3d846539b6b67", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:45:07.049834 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-TestVolumeBootPattern-1895289434 May 19 06:45:07.049834 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: 318e4e0d9f3a49f69eb3d846539b6b67 May 19 06:45:07.049834 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-TestVolumeBootPattern-1895289434 May 19 06:45:07.049834 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-TestVolumeBootPattern-1895289434-project May 19 06:45:07.049834 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:45:07.049834 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:45:07.049834 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: c1815cc5a2fd43259c5b53650dbc7603 May 19 06:45:07.049834 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-TestVolumeBootPattern-1895289434-project May 19 06:45:07.049834 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: > May 19 06:45:07.049834 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Instance abe88117-18ec-43f8-8e35-cf5070b67827 could not be found. May 19 06:45:07.049834 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'id': 'abe88117-18ec-43f8-8e35-cf5070b67827'} May 19 06:45:07.050877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:45:07.050877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:45:07.050877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:45:07.050877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:45:07.050877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:45:07.050877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:45:07.050877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:45:07.050877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:45:07.050877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:45:07.050877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:45:07.050877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abe88117-18ec-43f8-8e35-cf5070b67827 could not be found. May 19 06:45:07.050877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:45:07.050877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:45:07.050877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:45:07.050877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:45:07.050877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:45:07.050877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:45:07.050877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:45:07.050877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:45:07.050877 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:45:07.053063 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:45:07.053063 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:45:07.053063 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:45:07.053063 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:45:07.053063 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:45:07.053063 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:45:07.053063 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:45:07.053063 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abe88117-18ec-43f8-8e35-cf5070b67827 could not be found. May 19 06:45:07.053063 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:45:07.053063 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:45:07.053063 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:45:07.053063 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:45:07.053063 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:45:07.053063 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:45:07.053063 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:45:07.053063 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:45:07.053063 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abe88117-18ec-43f8-8e35-cf5070b67827 could not be found. May 19 06:45:07.053063 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:45:07.055392 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5de7f32c-c1a7-4e97-b5a2-fed3161946f5 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Returning 404 to user: Instance abe88117-18ec-43f8-8e35-cf5070b67827 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:45:07.055392 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5de7f32c-c1a7-4e97-b5a2-fed3161946f5 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827" status: 404 len: 111 microversion: 2.1 time: 0.033781 May 19 06:45:07.055392 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 490/982] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:45:07 2022] GET /compute/v2.1/servers/abe88117-18ec-43f8-8e35-cf5070b67827 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:45:10.115125 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a50824b3-b6b3-4c59-bdc4-a4332bac3c26 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:45:10.115665 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a50824b3-b6b3-4c59-bdc4-a4332bac3c26 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: b30b7860-ca60-424f-9480-55dd00c344b3] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:10.117361 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-702fe07d-257b-4296-87bc-82f9816a3f62 req-fcfbf7a0-48ee-4c4a-9a81-5a6f42ac89d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b30b7860-ca60-424f-9480-55dd00c344b3", "tag": "4ec87ea5-0d1a-4118-90d2-4552a0351194"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:45:10.123602 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a50824b3-b6b3-4c59-bdc4-a4332bac3c26 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:10.124432 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a50824b3-b6b3-4c59-bdc4-a4332bac3c26 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:10.125429 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a50824b3-b6b3-4c59-bdc4-a4332bac3c26 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:10.126024 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a50824b3-b6b3-4c59-bdc4-a4332bac3c26 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:10.127028 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-702fe07d-257b-4296-87bc-82f9816a3f62 req-fcfbf7a0-48ee-4c4a-9a81-5a6f42ac89d2 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:10.128097 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-702fe07d-257b-4296-87bc-82f9816a3f62 req-fcfbf7a0-48ee-4c4a-9a81-5a6f42ac89d2 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:10.140361 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-702fe07d-257b-4296-87bc-82f9816a3f62 req-fcfbf7a0-48ee-4c4a-9a81-5a6f42ac89d2 service nova] Creating event network-changed:4ec87ea5-0d1a-4118-90d2-4552a0351194 for instance b30b7860-ca60-424f-9480-55dd00c344b3 on hv-cinder-83699 May 19 06:45:10.145740 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-702fe07d-257b-4296-87bc-82f9816a3f62 req-fcfbf7a0-48ee-4c4a-9a81-5a6f42ac89d2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031946 May 19 06:45:10.146339 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 491/983] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:45:10.159325 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a50824b3-b6b3-4c59-bdc4-a4332bac3c26 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: b30b7860-ca60-424f-9480-55dd00c344b3] Going to try to terminate instance {{(pid=117712) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 06:45:10.258299 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a50824b3-b6b3-4c59-bdc4-a4332bac3c26 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3" status: 204 len: 0 microversion: 2.1 time: 0.147037 May 19 06:45:10.259273 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 493/984] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 06:45:10 2022] DELETE /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 06:45:10.268489 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8803e196-7d53-4934-910e-7e60633134aa tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:45:10.269197 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8803e196-7d53-4934-910e-7e60633134aa tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: b30b7860-ca60-424f-9480-55dd00c344b3] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:10.275574 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8803e196-7d53-4934-910e-7e60633134aa tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:10.276023 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8803e196-7d53-4934-910e-7e60633134aa tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:10.277009 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8803e196-7d53-4934-910e-7e60633134aa tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:10.277477 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8803e196-7d53-4934-910e-7e60633134aa tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:10.431033 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-8803e196-7d53-4934-910e-7e60633134aa tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:45:10.439274 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8803e196-7d53-4934-910e-7e60633134aa tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3" status: 200 len: 1578 microversion: 2.1 time: 0.175122 May 19 06:45:10.439847 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 492/985] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:45:10 2022] GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3 => generated 1578 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:45:11.457054 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-192511b3-1b8d-45df-bbd3-aeba2a952fe5 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:45:11.457799 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-192511b3-1b8d-45df-bbd3-aeba2a952fe5 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: b30b7860-ca60-424f-9480-55dd00c344b3] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:11.464979 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-192511b3-1b8d-45df-bbd3-aeba2a952fe5 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:11.465457 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-192511b3-1b8d-45df-bbd3-aeba2a952fe5 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:11.466224 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-192511b3-1b8d-45df-bbd3-aeba2a952fe5 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:11.466658 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-192511b3-1b8d-45df-bbd3-aeba2a952fe5 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:11.602567 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-192511b3-1b8d-45df-bbd3-aeba2a952fe5 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:45:11.610346 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-192511b3-1b8d-45df-bbd3-aeba2a952fe5 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3" status: 200 len: 1578 microversion: 2.1 time: 0.157523 May 19 06:45:11.611010 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 494/986] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:45:11 2022] GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:45:12.206939 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-40290ee3-e876-47af-8f6c-ba5d00d1a69f req-08c0d7f0-6d58-4e33-b4a2-389f1f4c84c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b30b7860-ca60-424f-9480-55dd00c344b3", "name": "network-vif-deleted", "tag": "4ec87ea5-0d1a-4118-90d2-4552a0351194"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:45:12.217355 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-40290ee3-e876-47af-8f6c-ba5d00d1a69f req-08c0d7f0-6d58-4e33-b4a2-389f1f4c84c2 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:12.217803 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-40290ee3-e876-47af-8f6c-ba5d00d1a69f req-08c0d7f0-6d58-4e33-b4a2-389f1f4c84c2 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:12.231524 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-40290ee3-e876-47af-8f6c-ba5d00d1a69f req-08c0d7f0-6d58-4e33-b4a2-389f1f4c84c2 service nova] Creating event network-vif-deleted:4ec87ea5-0d1a-4118-90d2-4552a0351194 for instance b30b7860-ca60-424f-9480-55dd00c344b3 on hv-cinder-83699 May 19 06:45:12.237037 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-40290ee3-e876-47af-8f6c-ba5d00d1a69f req-08c0d7f0-6d58-4e33-b4a2-389f1f4c84c2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033679 May 19 06:45:12.237717 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 493/987] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:45:12.627635 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1a97f413-ec7e-4762-9351-877b6d6f53ec tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:45:12.628245 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1a97f413-ec7e-4762-9351-877b6d6f53ec tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: b30b7860-ca60-424f-9480-55dd00c344b3] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:12.634731 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1a97f413-ec7e-4762-9351-877b6d6f53ec tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:12.635175 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1a97f413-ec7e-4762-9351-877b6d6f53ec tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:12.636601 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1a97f413-ec7e-4762-9351-877b6d6f53ec tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:12.637055 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1a97f413-ec7e-4762-9351-877b6d6f53ec tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:12.667328 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1a97f413-ec7e-4762-9351-877b6d6f53ec tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:12.667844 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1a97f413-ec7e-4762-9351-877b6d6f53ec tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:12.668210 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-1a97f413-ec7e-4762-9351-877b6d6f53ec tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lazy-loading 'fault' on Instance uuid b30b7860-ca60-424f-9480-55dd00c344b3 {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:45:12.711529 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1a97f413-ec7e-4762-9351-877b6d6f53ec tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1815cc5a2fd43259c5b53650dbc7603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318e4e0d9f3a49f69eb3d846539b6b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:45:12.720418 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1a97f413-ec7e-4762-9351-877b6d6f53ec tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3" status: 200 len: 1230 microversion: 2.1 time: 0.096896 May 19 06:45:12.721005 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 495/988] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:45:12 2022] GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3 => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:45:13.739020 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-109f757a-fa1c-4ee9-add2-d07ab0544663 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:45:13.739710 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-109f757a-fa1c-4ee9-add2-d07ab0544663 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: b30b7860-ca60-424f-9480-55dd00c344b3] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:13.747148 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-109f757a-fa1c-4ee9-add2-d07ab0544663 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:13.747601 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-109f757a-fa1c-4ee9-add2-d07ab0544663 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:13.748370 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-109f757a-fa1c-4ee9-add2-d07ab0544663 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:13.748811 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-109f757a-fa1c-4ee9-add2-d07ab0544663 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:13.763907 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-109f757a-fa1c-4ee9-add2-d07ab0544663 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] HTTP exception thrown: Instance b30b7860-ca60-424f-9480-55dd00c344b3 could not be found. May 19 06:45:13.765658 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-109f757a-fa1c-4ee9-add2-d07ab0544663 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Request method failure captured: May 19 06:45:13.765658 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3 HTTP/1.1 May 19 06:45:13.765658 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:45:13.765658 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:45:13.765658 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:45:13.765658 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 0 May 19 06:45:13.765658 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:45:13.765658 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:45:13.765658 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:45:13.765658 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:45:13.765658 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheXall9X50KtUoZq9BPO9h6Yh2juusugfh8Sq73pNXs2xGe2hGmMnOTHDMSF5p6yV7wLf7AFdaImgynbtulmSQiGJTUoNfpnNILlvmbC7F63-nq-xi2381Q4AbJDMgHzqbWyUKas4MHnelO6PbPnJnZsnt76MOtJLHSOFX7LBJuM6CY May 19 06:45:13.765658 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:45:13.765658 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:45:13.765658 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:45:13.765658 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:45:13.765658 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:45:13.765658 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:45:13.765658 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: 318e4e0d9f3a49f69eb3d846539b6b67 May 19 06:45:13.765658 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-TestVolumeBootPattern-1895289434 May 19 06:45:13.765658 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:45:13.765658 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:45:13.767495 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/318e4e0d9f3a49f69eb3d846539b6b67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/318e4e0d9f3a49f69eb3d846539b6b67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/318e4e0d9f3a49f69eb3d846539b6b67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_318e4e0d9f3a49f69eb3d846539b6b67", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:45:13.767495 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-TestVolumeBootPattern-1895289434 May 19 06:45:13.767495 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: 318e4e0d9f3a49f69eb3d846539b6b67 May 19 06:45:13.767495 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-TestVolumeBootPattern-1895289434 May 19 06:45:13.767495 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-TestVolumeBootPattern-1895289434-project May 19 06:45:13.767495 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:45:13.767495 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:45:13.767495 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: c1815cc5a2fd43259c5b53650dbc7603 May 19 06:45:13.767495 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-TestVolumeBootPattern-1895289434-project May 19 06:45:13.767495 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: > May 19 06:45:13.767495 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Instance b30b7860-ca60-424f-9480-55dd00c344b3 could not be found. May 19 06:45:13.767495 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'id': 'b30b7860-ca60-424f-9480-55dd00c344b3'} May 19 06:45:13.768627 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:45:13.768627 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:45:13.768627 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:45:13.768627 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:45:13.768627 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:45:13.768627 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:45:13.768627 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:45:13.768627 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:45:13.768627 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:45:13.768627 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:45:13.768627 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b30b7860-ca60-424f-9480-55dd00c344b3 could not be found. May 19 06:45:13.768627 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:45:13.768627 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:45:13.768627 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:45:13.768627 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:45:13.768627 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:45:13.768627 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:45:13.768627 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:45:13.768627 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:45:13.768627 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:45:13.770366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:45:13.770366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:45:13.770366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:45:13.770366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:45:13.770366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:45:13.770366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:45:13.770366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:45:13.770366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b30b7860-ca60-424f-9480-55dd00c344b3 could not be found. May 19 06:45:13.770366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:45:13.770366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:45:13.770366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:45:13.770366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:45:13.770366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:45:13.770366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:45:13.770366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:45:13.770366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:45:13.770366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b30b7860-ca60-424f-9480-55dd00c344b3 could not be found. May 19 06:45:13.770366 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:45:13.772007 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-109f757a-fa1c-4ee9-add2-d07ab0544663 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Returning 404 to user: Instance b30b7860-ca60-424f-9480-55dd00c344b3 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:45:13.772007 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-109f757a-fa1c-4ee9-add2-d07ab0544663 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3" status: 404 len: 111 microversion: 2.1 time: 0.032264 May 19 06:45:13.772007 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 494/989] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:45:13 2022] GET /compute/v2.1/servers/b30b7860-ca60-424f-9480-55dd00c344b3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:45:14.200307 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-5c44ccc3-1a6e-46f3-9d55-68ba9244f25f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:45:14.200829 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-5c44ccc3-1a6e-46f3-9d55-68ba9244f25f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:14.207053 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5c44ccc3-1a6e-46f3-9d55-68ba9244f25f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:14.207495 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5c44ccc3-1a6e-46f3-9d55-68ba9244f25f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:14.208249 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5c44ccc3-1a6e-46f3-9d55-68ba9244f25f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:14.208676 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5c44ccc3-1a6e-46f3-9d55-68ba9244f25f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:14.221678 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-5c44ccc3-1a6e-46f3-9d55-68ba9244f25f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] HTTP exception thrown: Instance 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f could not be found. May 19 06:45:14.223320 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-5c44ccc3-1a6e-46f3-9d55-68ba9244f25f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Request method failure captured: May 19 06:45:14.223320 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: request: DELETE /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f HTTP/1.1 May 19 06:45:14.223320 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept: application/json May 19 06:45:14.223320 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity May 19 06:45:14.223320 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Connection: close May 19 06:45:14.223320 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Length: 0 May 19 06:45:14.223320 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Content-Type: application/json May 19 06:45:14.223320 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Host: 10.222.0.65 May 19 06:45:14.223320 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None May 19 06:45:14.223320 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 May 19 06:45:14.223320 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiheXall9X50KtUoZq9BPO9h6Yh2juusugfh8Sq73pNXs2xGe2hGmMnOTHDMSF5p6yV7wLf7AFdaImgynbtulmSQiGJTUoNfpnNILlvmbC7F63-nq-xi2381Q4AbJDMgHzqbWyUKas4MHnelO6PbPnJnZsnt76MOtJLHSOFX7LBJuM6CY May 19 06:45:14.223320 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Id: None May 19 06:45:14.223320 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Domain-Name: None May 19 06:45:14.223320 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed May 19 06:45:14.223320 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True May 19 06:45:14.223320 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default May 19 06:45:14.223320 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default May 19 06:45:14.223320 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Id: 318e4e0d9f3a49f69eb3d846539b6b67 May 19 06:45:14.223320 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-TestVolumeBootPattern-1895289434 May 19 06:45:14.223320 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Role: reader,member May 19 06:45:14.223320 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Roles: reader,member May 19 06:45:14.224950 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/318e4e0d9f3a49f69eb3d846539b6b67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/318e4e0d9f3a49f69eb3d846539b6b67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/318e4e0d9f3a49f69eb3d846539b6b67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_318e4e0d9f3a49f69eb3d846539b6b67", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:45:14.224950 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-TestVolumeBootPattern-1895289434 May 19 06:45:14.224950 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Id: 318e4e0d9f3a49f69eb3d846539b6b67 May 19 06:45:14.224950 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-TestVolumeBootPattern-1895289434 May 19 06:45:14.224950 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User: tempest-TestVolumeBootPattern-1895289434-project May 19 06:45:14.224950 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default May 19 06:45:14.224950 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default May 19 06:45:14.224950 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Id: c1815cc5a2fd43259c5b53650dbc7603 May 19 06:45:14.224950 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-TestVolumeBootPattern-1895289434-project May 19 06:45:14.224950 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: method: > May 19 06:45:14.224950 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: exception: Instance 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f could not be found. May 19 06:45:14.224950 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: action_args: {'id': '68fefa96-69e6-4e4b-86ad-b0c8bae70b5f'} May 19 06:45:14.225937 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:45:14.225937 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:45:14.225937 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:45:14.225937 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:45:14.225937 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:45:14.225937 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:45:14.225937 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:45:14.225937 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:45:14.225937 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:45:14.225937 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:45:14.225937 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f could not be found. May 19 06:45:14.225937 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:45:14.225937 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:45:14.225937 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:45:14.225937 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:45:14.225937 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:45:14.225937 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:45:14.225937 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:45:14.225937 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:45:14.225937 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:45:14.227495 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:45:14.227495 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 06:45:14.227495 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 06:45:14.227495 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 06:45:14.227495 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 06:45:14.227495 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:45:14.227495 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:45:14.227495 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:45:14.227495 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:45:14.227495 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f could not be found. May 19 06:45:14.227495 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:45:14.227495 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:45:14.227495 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:45:14.227495 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:45:14.227495 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:45:14.227495 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:45:14.227495 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:45:14.227495 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:45:14.227495 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f could not be found. May 19 06:45:14.227495 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi May 19 06:45:14.230028 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-5c44ccc3-1a6e-46f3-9d55-68ba9244f25f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Returning 404 to user: Instance 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:45:14.230028 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-5c44ccc3-1a6e-46f3-9d55-68ba9244f25f tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "DELETE /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f" status: 404 len: 111 microversion: 2.1 time: 0.028444 May 19 06:45:14.230028 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 496/990] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 06:45:14 2022] DELETE /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:45:14.233748 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b14c2f12-28eb-4568-af11-ba3b9a6ac1d2 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:45:14.234351 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b14c2f12-28eb-4568-af11-ba3b9a6ac1d2 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] [instance: 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:14.240296 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b14c2f12-28eb-4568-af11-ba3b9a6ac1d2 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:14.240733 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b14c2f12-28eb-4568-af11-ba3b9a6ac1d2 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:14.241507 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b14c2f12-28eb-4568-af11-ba3b9a6ac1d2 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:14.241936 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b14c2f12-28eb-4568-af11-ba3b9a6ac1d2 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:14.257564 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-b14c2f12-28eb-4568-af11-ba3b9a6ac1d2 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] HTTP exception thrown: Instance 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f could not be found. May 19 06:45:14.259055 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b14c2f12-28eb-4568-af11-ba3b9a6ac1d2 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Request method failure captured: May 19 06:45:14.259055 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f HTTP/1.1 May 19 06:45:14.259055 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:45:14.259055 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:45:14.259055 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:45:14.259055 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 0 May 19 06:45:14.259055 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:45:14.259055 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:45:14.259055 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:45:14.259055 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:45:14.259055 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheXall9X50KtUoZq9BPO9h6Yh2juusugfh8Sq73pNXs2xGe2hGmMnOTHDMSF5p6yV7wLf7AFdaImgynbtulmSQiGJTUoNfpnNILlvmbC7F63-nq-xi2381Q4AbJDMgHzqbWyUKas4MHnelO6PbPnJnZsnt76MOtJLHSOFX7LBJuM6CY May 19 06:45:14.259055 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:45:14.259055 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:45:14.259055 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:45:14.259055 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:45:14.259055 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:45:14.259055 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:45:14.259055 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: 318e4e0d9f3a49f69eb3d846539b6b67 May 19 06:45:14.259055 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-TestVolumeBootPattern-1895289434 May 19 06:45:14.259055 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:45:14.259055 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:45:14.261409 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/318e4e0d9f3a49f69eb3d846539b6b67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/318e4e0d9f3a49f69eb3d846539b6b67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/318e4e0d9f3a49f69eb3d846539b6b67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_318e4e0d9f3a49f69eb3d846539b6b67", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:45:14.261409 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-TestVolumeBootPattern-1895289434 May 19 06:45:14.261409 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: 318e4e0d9f3a49f69eb3d846539b6b67 May 19 06:45:14.261409 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-TestVolumeBootPattern-1895289434 May 19 06:45:14.261409 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-TestVolumeBootPattern-1895289434-project May 19 06:45:14.261409 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:45:14.261409 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:45:14.261409 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: c1815cc5a2fd43259c5b53650dbc7603 May 19 06:45:14.261409 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-TestVolumeBootPattern-1895289434-project May 19 06:45:14.261409 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: > May 19 06:45:14.261409 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Instance 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f could not be found. May 19 06:45:14.261409 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'id': '68fefa96-69e6-4e4b-86ad-b0c8bae70b5f'} May 19 06:45:14.262363 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:45:14.262363 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:45:14.262363 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:45:14.262363 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:45:14.262363 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:45:14.262363 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:45:14.262363 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:45:14.262363 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:45:14.262363 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:45:14.262363 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:45:14.262363 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f could not be found. May 19 06:45:14.262363 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:45:14.262363 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:45:14.262363 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:45:14.262363 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:45:14.262363 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:45:14.262363 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:45:14.262363 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:45:14.262363 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:45:14.262363 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:45:14.263911 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:45:14.263911 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:45:14.263911 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:45:14.263911 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:45:14.263911 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:45:14.263911 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:45:14.263911 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:45:14.263911 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f could not be found. May 19 06:45:14.263911 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:45:14.263911 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:45:14.263911 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:45:14.263911 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:45:14.263911 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:45:14.263911 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:45:14.263911 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:45:14.263911 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:45:14.263911 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f could not be found. May 19 06:45:14.263911 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:45:14.265624 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b14c2f12-28eb-4568-af11-ba3b9a6ac1d2 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Returning 404 to user: Instance 68fefa96-69e6-4e4b-86ad-b0c8bae70b5f could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:45:14.265624 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b14c2f12-28eb-4568-af11-ba3b9a6ac1d2 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f" status: 404 len: 111 microversion: 2.1 time: 0.030962 May 19 06:45:14.265624 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 495/991] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:45:14 2022] GET /compute/v2.1/servers/68fefa96-69e6-4e4b-86ad-b0c8bae70b5f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 06:45:15.559009 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-31e92bd8-1235-4343-8e90-e095a17d8085 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] Calling method '.version_select at 0x7f9aeaf65790>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:45:15.583066 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-31e92bd8-1235-4343-8e90-e095a17d8085 tempest-TestVolumeBootPattern-1895289434 tempest-TestVolumeBootPattern-1895289434-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1671934445" status: 202 len: 0 microversion: 2.1 time: 0.028660 May 19 06:45:15.583556 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 497/992] 10.222.0.65 () {58 vars in 1262 bytes} [Thu May 19 06:45:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1671934445 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 06:45:39.589394 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-06980d96-01cc-468d-92f7-064b446abfd7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:45:39.589979 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-06980d96-01cc-468d-92f7-064b446abfd7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:39.592273 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=18 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:45:39.592895 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=26 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:45:39.598612 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-06980d96-01cc-468d-92f7-064b446abfd7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:39.599060 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-06980d96-01cc-468d-92f7-064b446abfd7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:39.599809 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-06980d96-01cc-468d-92f7-064b446abfd7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:39.600239 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-06980d96-01cc-468d-92f7-064b446abfd7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:39.623936 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-06980d96-01cc-468d-92f7-064b446abfd7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lazy-loading 'flavor' on Instance uuid 6d3432db-453c-433c-8644-7aef9960fb7b {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:45:39.694726 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-06980d96-01cc-468d-92f7-064b446abfd7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "POST /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b/action" status: 202 len: 0 microversion: 2.1 time: 0.109143 May 19 06:45:39.695401 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 496/993] 10.222.0.65 () {60 vars in 1277 bytes} [Thu May 19 06:45:39 2022] POST /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 06:45:39.701677 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:45:39.702523 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:45:39.707123 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-38546aaa-65a6-4963-869c-b2d0a0474ba7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:45:39.707740 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-38546aaa-65a6-4963-869c-b2d0a0474ba7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:39.716640 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-38546aaa-65a6-4963-869c-b2d0a0474ba7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:39.717098 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-38546aaa-65a6-4963-869c-b2d0a0474ba7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:39.717935 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-38546aaa-65a6-4963-869c-b2d0a0474ba7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:39.718449 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-38546aaa-65a6-4963-869c-b2d0a0474ba7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:40.074183 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-38546aaa-65a6-4963-869c-b2d0a0474ba7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:45:40.082001 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-38546aaa-65a6-4963-869c-b2d0a0474ba7 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1570 microversion: 2.1 time: 0.381949 May 19 06:45:40.082577 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 498/994] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:45:39 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1570 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:45:41.099799 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 06:45:41.100597 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Thu May 19 06:45:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b (ip 10.222.0.65) !!! May 19 06:45:41.102840 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3286712e-4a65-4460-a66e-100a36375bc5 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:45:41.104042 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-3286712e-4a65-4460-a66e-100a36375bc5 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:41.115751 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3286712e-4a65-4460-a66e-100a36375bc5 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:41.117788 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3286712e-4a65-4460-a66e-100a36375bc5 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:41.119278 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3286712e-4a65-4460-a66e-100a36375bc5 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:41.120151 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3286712e-4a65-4460-a66e-100a36375bc5 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:41.311705 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3286712e-4a65-4460-a66e-100a36375bc5 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:45:41.319299 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-3286712e-4a65-4460-a66e-100a36375bc5 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1570 microversion: 2.1 time: 0.222980 May 19 06:45:41.319873 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 497/995] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:45:41 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1570 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:45:42.337242 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-158ce826-3da7-48ef-8e5b-3c880ebb292c tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:45:42.338197 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-158ce826-3da7-48ef-8e5b-3c880ebb292c tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:42.345017 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-158ce826-3da7-48ef-8e5b-3c880ebb292c tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:42.345517 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-158ce826-3da7-48ef-8e5b-3c880ebb292c tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:42.346282 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-158ce826-3da7-48ef-8e5b-3c880ebb292c tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:42.346714 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-158ce826-3da7-48ef-8e5b-3c880ebb292c tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:42.479260 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-158ce826-3da7-48ef-8e5b-3c880ebb292c tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:45:42.486807 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-158ce826-3da7-48ef-8e5b-3c880ebb292c tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1570 microversion: 2.1 time: 0.153655 May 19 06:45:42.487416 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 499/996] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:45:42 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:45:43.503958 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0bcdc2f8-10ae-4b40-9446-789493191bf1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:45:43.504569 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0bcdc2f8-10ae-4b40-9446-789493191bf1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:43.511145 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0bcdc2f8-10ae-4b40-9446-789493191bf1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:43.511586 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0bcdc2f8-10ae-4b40-9446-789493191bf1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:43.512911 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0bcdc2f8-10ae-4b40-9446-789493191bf1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:43.513731 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0bcdc2f8-10ae-4b40-9446-789493191bf1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:43.647571 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0bcdc2f8-10ae-4b40-9446-789493191bf1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:45:43.656004 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0bcdc2f8-10ae-4b40-9446-789493191bf1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1570 microversion: 2.1 time: 0.155870 May 19 06:45:43.656570 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 498/997] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:45:43 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:45:44.674120 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7f5f8553-ba92-4284-9b71-d62beb1d9904 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:45:44.674709 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7f5f8553-ba92-4284-9b71-d62beb1d9904 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:44.680783 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7f5f8553-ba92-4284-9b71-d62beb1d9904 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:44.681224 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7f5f8553-ba92-4284-9b71-d62beb1d9904 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:44.681997 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7f5f8553-ba92-4284-9b71-d62beb1d9904 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:44.682422 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7f5f8553-ba92-4284-9b71-d62beb1d9904 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:44.815262 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7f5f8553-ba92-4284-9b71-d62beb1d9904 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:45:44.822766 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7f5f8553-ba92-4284-9b71-d62beb1d9904 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1570 microversion: 2.1 time: 0.152522 May 19 06:45:44.823329 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 500/998] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:45:44 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:45:45.839822 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7ef3b353-b1a3-48b1-b3e7-a4943402eb1d tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:45:45.840487 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7ef3b353-b1a3-48b1-b3e7-a4943402eb1d tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:45.847304 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7ef3b353-b1a3-48b1-b3e7-a4943402eb1d tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:45.847754 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7ef3b353-b1a3-48b1-b3e7-a4943402eb1d tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:45.848520 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7ef3b353-b1a3-48b1-b3e7-a4943402eb1d tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:45.848958 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7ef3b353-b1a3-48b1-b3e7-a4943402eb1d tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:45.979621 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7ef3b353-b1a3-48b1-b3e7-a4943402eb1d tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:45:45.988407 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7ef3b353-b1a3-48b1-b3e7-a4943402eb1d tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1570 microversion: 2.1 time: 0.152401 May 19 06:45:45.989195 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 499/999] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:45:45 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:45:47.009506 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-116f83a2-32d5-455a-b730-6cd109ec72e1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:45:47.010096 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-116f83a2-32d5-455a-b730-6cd109ec72e1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:47.016555 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-116f83a2-32d5-455a-b730-6cd109ec72e1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:47.017003 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-116f83a2-32d5-455a-b730-6cd109ec72e1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:47.017789 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-116f83a2-32d5-455a-b730-6cd109ec72e1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:47.018220 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-116f83a2-32d5-455a-b730-6cd109ec72e1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:47.149764 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-116f83a2-32d5-455a-b730-6cd109ec72e1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:45:47.158033 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-116f83a2-32d5-455a-b730-6cd109ec72e1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1570 microversion: 2.1 time: 0.152435 May 19 06:45:47.158604 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 501/1000] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:45:47 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:45:48.174931 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-eb4164df-062e-4ff6-83aa-7ee5b51dfd50 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:45:48.175568 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-eb4164df-062e-4ff6-83aa-7ee5b51dfd50 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:48.182072 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb4164df-062e-4ff6-83aa-7ee5b51dfd50 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:48.182526 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb4164df-062e-4ff6-83aa-7ee5b51dfd50 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:48.183280 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb4164df-062e-4ff6-83aa-7ee5b51dfd50 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:48.183714 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb4164df-062e-4ff6-83aa-7ee5b51dfd50 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:48.317221 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-eb4164df-062e-4ff6-83aa-7ee5b51dfd50 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:45:48.325459 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-eb4164df-062e-4ff6-83aa-7ee5b51dfd50 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1570 microversion: 2.1 time: 0.153759 May 19 06:45:48.326179 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 500/1001] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:45:48 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:45:49.344202 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ba72d730-f765-4830-a0aa-ef0fde58214e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:45:49.344955 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ba72d730-f765-4830-a0aa-ef0fde58214e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:49.351626 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ba72d730-f765-4830-a0aa-ef0fde58214e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:49.352156 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ba72d730-f765-4830-a0aa-ef0fde58214e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:49.352935 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ba72d730-f765-4830-a0aa-ef0fde58214e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:49.353400 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ba72d730-f765-4830-a0aa-ef0fde58214e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:49.487258 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ba72d730-f765-4830-a0aa-ef0fde58214e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:45:49.495087 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ba72d730-f765-4830-a0aa-ef0fde58214e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1570 microversion: 2.1 time: 0.156219 May 19 06:45:49.495890 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 502/1002] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:45:49 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:45:50.512128 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-56c3e9e8-94a7-408a-bff9-ead06541344c tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:45:50.512764 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-56c3e9e8-94a7-408a-bff9-ead06541344c tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:50.520131 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-56c3e9e8-94a7-408a-bff9-ead06541344c tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:50.520581 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-56c3e9e8-94a7-408a-bff9-ead06541344c tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:50.521367 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-56c3e9e8-94a7-408a-bff9-ead06541344c tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:50.521804 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-56c3e9e8-94a7-408a-bff9-ead06541344c tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:50.658277 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-56c3e9e8-94a7-408a-bff9-ead06541344c tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:45:50.665973 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-56c3e9e8-94a7-408a-bff9-ead06541344c tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1570 microversion: 2.1 time: 0.157749 May 19 06:45:50.666532 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 501/1003] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:45:50 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:45:51.683084 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d8c3822d-c104-4b8f-8f9d-04f73ef0ea72 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:45:51.683703 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d8c3822d-c104-4b8f-8f9d-04f73ef0ea72 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:51.690430 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d8c3822d-c104-4b8f-8f9d-04f73ef0ea72 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:51.690880 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d8c3822d-c104-4b8f-8f9d-04f73ef0ea72 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:51.691650 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d8c3822d-c104-4b8f-8f9d-04f73ef0ea72 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:51.692081 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d8c3822d-c104-4b8f-8f9d-04f73ef0ea72 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:51.829995 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d8c3822d-c104-4b8f-8f9d-04f73ef0ea72 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:45:51.838150 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d8c3822d-c104-4b8f-8f9d-04f73ef0ea72 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1570 microversion: 2.1 time: 0.158844 May 19 06:45:51.839047 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 503/1004] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:45:51 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:45:52.861996 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-43c2cf51-415e-4600-bdb9-3c23c2351779 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:45:52.862584 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-43c2cf51-415e-4600-bdb9-3c23c2351779 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:52.868981 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-43c2cf51-415e-4600-bdb9-3c23c2351779 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:52.869457 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-43c2cf51-415e-4600-bdb9-3c23c2351779 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:52.870207 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-43c2cf51-415e-4600-bdb9-3c23c2351779 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:52.870632 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-43c2cf51-415e-4600-bdb9-3c23c2351779 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:53.003018 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-43c2cf51-415e-4600-bdb9-3c23c2351779 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:45:53.010495 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-43c2cf51-415e-4600-bdb9-3c23c2351779 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1511 microversion: 2.1 time: 0.153146 May 19 06:45:53.011047 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 502/1005] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:45:52 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:45:53.027327 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c32778e6-4e6b-49e7-ad78-8f91d4bb1c23 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:45:53.027898 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c32778e6-4e6b-49e7-ad78-8f91d4bb1c23 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:53.034533 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c32778e6-4e6b-49e7-ad78-8f91d4bb1c23 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:53.034984 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c32778e6-4e6b-49e7-ad78-8f91d4bb1c23 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:53.035997 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c32778e6-4e6b-49e7-ad78-8f91d4bb1c23 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:53.036426 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c32778e6-4e6b-49e7-ad78-8f91d4bb1c23 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:53.110822 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c32778e6-4e6b-49e7-ad78-8f91d4bb1c23 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [6d7c895c-b890-455a-be65-f91428cecaab] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 06:45:54.119036 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO oslo.messaging._drivers.impl_rabbit [None req-c32778e6-4e6b-49e7-ad78-8f91d4bb1c23 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [6d7c895c-b890-455a-be65-f91428cecaab] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 43372. May 19 06:45:54.126211 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c32778e6-4e6b-49e7-ad78-8f91d4bb1c23 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "POST /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b/action" status: 202 len: 0 microversion: 2.1 time: 1.102824 May 19 06:45:54.126833 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 504/1006] 10.222.0.65 () {60 vars in 1277 bytes} [Thu May 19 06:45:53 2022] POST /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b/action => generated 0 bytes in 1104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 06:45:54.139661 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b81786f5-5ae4-473b-b40b-bd530e2bbd4f tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:45:54.140466 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b81786f5-5ae4-473b-b40b-bd530e2bbd4f tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:54.147268 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b81786f5-5ae4-473b-b40b-bd530e2bbd4f tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:54.147709 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b81786f5-5ae4-473b-b40b-bd530e2bbd4f tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:54.148463 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b81786f5-5ae4-473b-b40b-bd530e2bbd4f tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:54.148890 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b81786f5-5ae4-473b-b40b-bd530e2bbd4f tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:54.285085 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b81786f5-5ae4-473b-b40b-bd530e2bbd4f tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:45:54.292826 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b81786f5-5ae4-473b-b40b-bd530e2bbd4f tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1519 microversion: 2.1 time: 0.157564 May 19 06:45:54.293419 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 503/1007] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:45:54 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:45:55.313505 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-8f70fc24-1aa1-4061-8f64-669a99e39ca1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:45:55.314030 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-8f70fc24-1aa1-4061-8f64-669a99e39ca1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:55.320890 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8f70fc24-1aa1-4061-8f64-669a99e39ca1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:55.321349 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8f70fc24-1aa1-4061-8f64-669a99e39ca1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:55.322114 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8f70fc24-1aa1-4061-8f64-669a99e39ca1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:55.322542 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8f70fc24-1aa1-4061-8f64-669a99e39ca1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:55.458199 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8f70fc24-1aa1-4061-8f64-669a99e39ca1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:45:55.467337 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-8f70fc24-1aa1-4061-8f64-669a99e39ca1 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1577 microversion: 2.1 time: 0.158046 May 19 06:45:55.468098 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 505/1008] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:45:55 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:45:56.485738 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-84e87abd-4e0a-4e5d-bf03-f2d9cdec848a tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:45:56.486350 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-84e87abd-4e0a-4e5d-bf03-f2d9cdec848a tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:56.492773 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-84e87abd-4e0a-4e5d-bf03-f2d9cdec848a tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:56.493220 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-84e87abd-4e0a-4e5d-bf03-f2d9cdec848a tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:56.494016 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-84e87abd-4e0a-4e5d-bf03-f2d9cdec848a tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:56.494451 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-84e87abd-4e0a-4e5d-bf03-f2d9cdec848a tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:56.630463 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-84e87abd-4e0a-4e5d-bf03-f2d9cdec848a tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:45:56.637926 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-84e87abd-4e0a-4e5d-bf03-f2d9cdec848a tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1577 microversion: 2.1 time: 0.156268 May 19 06:45:56.638490 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 504/1009] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:45:56 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:45:56.783799 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-48dc1baf-416e-4d70-a8ec-8afa76bc3858 req-0645a528-d5ba-4a70-9007-dcdd2d23bba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d3432db-453c-433c-8644-7aef9960fb7b", "name": "network-vif-unplugged", "status": "completed", "tag": "96bc5f89-9dca-4662-8882-eed7169c3f63"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:45:56.792671 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-48dc1baf-416e-4d70-a8ec-8afa76bc3858 req-0645a528-d5ba-4a70-9007-dcdd2d23bba5 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:56.793107 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-48dc1baf-416e-4d70-a8ec-8afa76bc3858 req-0645a528-d5ba-4a70-9007-dcdd2d23bba5 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:56.804583 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-48dc1baf-416e-4d70-a8ec-8afa76bc3858 req-0645a528-d5ba-4a70-9007-dcdd2d23bba5 service nova] Creating event network-vif-unplugged:96bc5f89-9dca-4662-8882-eed7169c3f63 for instance 6d3432db-453c-433c-8644-7aef9960fb7b on hv-cinder-83699 May 19 06:45:56.809573 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-48dc1baf-416e-4d70-a8ec-8afa76bc3858 req-0645a528-d5ba-4a70-9007-dcdd2d23bba5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030643 May 19 06:45:56.810280 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 506/1010] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:45:57.662301 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7b9e95e7-277f-4d8d-a2cf-b6c7bd04aefa tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:45:57.662883 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7b9e95e7-277f-4d8d-a2cf-b6c7bd04aefa tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:57.669242 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7b9e95e7-277f-4d8d-a2cf-b6c7bd04aefa tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:57.669715 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7b9e95e7-277f-4d8d-a2cf-b6c7bd04aefa tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:57.670464 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7b9e95e7-277f-4d8d-a2cf-b6c7bd04aefa tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:57.670899 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7b9e95e7-277f-4d8d-a2cf-b6c7bd04aefa tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:57.807624 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7b9e95e7-277f-4d8d-a2cf-b6c7bd04aefa tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:45:57.816611 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7b9e95e7-277f-4d8d-a2cf-b6c7bd04aefa tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1577 microversion: 2.1 time: 0.158332 May 19 06:45:57.817200 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 505/1011] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:45:57 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:45:58.835801 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f38095c6-31e5-4e66-993b-9194d3574f09 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:45:58.836498 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f38095c6-31e5-4e66-993b-9194d3574f09 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:45:58.842692 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f38095c6-31e5-4e66-993b-9194d3574f09 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:58.843134 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f38095c6-31e5-4e66-993b-9194d3574f09 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:58.844772 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f38095c6-31e5-4e66-993b-9194d3574f09 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:45:58.845205 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f38095c6-31e5-4e66-993b-9194d3574f09 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:45:58.980591 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f38095c6-31e5-4e66-993b-9194d3574f09 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:45:58.988649 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f38095c6-31e5-4e66-993b-9194d3574f09 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1577 microversion: 2.1 time: 0.157644 May 19 06:45:58.989221 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 507/1012] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:45:58 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:46:00.006623 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-744323f8-4158-4237-a0b7-caaec0d3ccb0 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:46:00.007236 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-744323f8-4158-4237-a0b7-caaec0d3ccb0 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:46:00.013858 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-744323f8-4158-4237-a0b7-caaec0d3ccb0 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:46:00.014302 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-744323f8-4158-4237-a0b7-caaec0d3ccb0 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:46:00.015054 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-744323f8-4158-4237-a0b7-caaec0d3ccb0 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:46:00.016096 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-744323f8-4158-4237-a0b7-caaec0d3ccb0 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:46:00.146563 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-744323f8-4158-4237-a0b7-caaec0d3ccb0 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:46:00.157474 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-744323f8-4158-4237-a0b7-caaec0d3ccb0 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1577 microversion: 2.1 time: 0.151802 May 19 06:46:00.157474 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 506/1013] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:46:00 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:46:01.171576 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a915c5f5-f802-4d29-be77-6409c4930b24 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:46:01.172192 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a915c5f5-f802-4d29-be77-6409c4930b24 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:46:01.178956 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a915c5f5-f802-4d29-be77-6409c4930b24 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:46:01.179407 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a915c5f5-f802-4d29-be77-6409c4930b24 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:46:01.180179 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a915c5f5-f802-4d29-be77-6409c4930b24 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:46:01.180612 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a915c5f5-f802-4d29-be77-6409c4930b24 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:46:01.311336 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a915c5f5-f802-4d29-be77-6409c4930b24 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:46:01.319474 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a915c5f5-f802-4d29-be77-6409c4930b24 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1577 microversion: 2.1 time: 0.151855 May 19 06:46:01.320036 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 508/1014] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:46:01 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:46:02.340193 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d1fbad59-bfa6-465c-a8a4-90d20a6c5c7e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:46:02.340800 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d1fbad59-bfa6-465c-a8a4-90d20a6c5c7e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:46:02.348083 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d1fbad59-bfa6-465c-a8a4-90d20a6c5c7e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:46:02.348524 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d1fbad59-bfa6-465c-a8a4-90d20a6c5c7e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:46:02.349275 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d1fbad59-bfa6-465c-a8a4-90d20a6c5c7e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:46:02.349731 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d1fbad59-bfa6-465c-a8a4-90d20a6c5c7e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:46:02.479596 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d1fbad59-bfa6-465c-a8a4-90d20a6c5c7e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:46:02.487249 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d1fbad59-bfa6-465c-a8a4-90d20a6c5c7e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1577 microversion: 2.1 time: 0.150959 May 19 06:46:02.487810 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 507/1015] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:46:02 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:46:03.504792 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-52132bba-c98a-4d39-8bd9-7c9c1362373f tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:46:03.505425 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-52132bba-c98a-4d39-8bd9-7c9c1362373f tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:46:03.512652 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-52132bba-c98a-4d39-8bd9-7c9c1362373f tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:46:03.513102 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-52132bba-c98a-4d39-8bd9-7c9c1362373f tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:46:03.513903 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-52132bba-c98a-4d39-8bd9-7c9c1362373f tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:46:03.514333 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-52132bba-c98a-4d39-8bd9-7c9c1362373f tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:46:03.646672 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-52132bba-c98a-4d39-8bd9-7c9c1362373f tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:46:03.654168 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-52132bba-c98a-4d39-8bd9-7c9c1362373f tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1564 microversion: 2.1 time: 0.154036 May 19 06:46:03.654732 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 509/1016] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:46:03 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:46:06.995394 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-e71b4457-8f9b-469e-8285-04bededcc117 req-445f6b3b-c3b7-45ae-9e0a-5617c4e3c04f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d3432db-453c-433c-8644-7aef9960fb7b", "name": "network-vif-plugged", "status": "completed", "tag": "96bc5f89-9dca-4662-8882-eed7169c3f63"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:46:07.004893 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-e71b4457-8f9b-469e-8285-04bededcc117 req-445f6b3b-c3b7-45ae-9e0a-5617c4e3c04f service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:46:07.005371 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-e71b4457-8f9b-469e-8285-04bededcc117 req-445f6b3b-c3b7-45ae-9e0a-5617c4e3c04f service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:46:07.019377 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-e71b4457-8f9b-469e-8285-04bededcc117 req-445f6b3b-c3b7-45ae-9e0a-5617c4e3c04f service nova] Creating event network-vif-plugged:96bc5f89-9dca-4662-8882-eed7169c3f63 for instance 6d3432db-453c-433c-8644-7aef9960fb7b on hv-cinder-83699 May 19 06:46:07.024336 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-e71b4457-8f9b-469e-8285-04bededcc117 req-445f6b3b-c3b7-45ae-9e0a-5617c4e3c04f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032798 May 19 06:46:07.024928 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 508/1017] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:46:10.014678 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 06:46:10.015388 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Thu May 19 06:46:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 06:47:16.764723 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: ERROR oslo.messaging._drivers.impl_rabbit [-] [583768b3-8e89-45f3-ba07-83e67e9b2b80] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 06:47:16.765563 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=26 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:47:16.766323 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:47:16.770405 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=26 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:47:16.770941 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-5d3b3bff-bdda-465d-b902-4d1ee8cebfc3 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:47:16.771315 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-5d3b3bff-bdda-465d-b902-4d1ee8cebfc3 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:47:16.771440 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:47:16.792076 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5d3b3bff-bdda-465d-b902-4d1ee8cebfc3 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:47:16.792951 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5d3b3bff-bdda-465d-b902-4d1ee8cebfc3 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:47:16.794029 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5d3b3bff-bdda-465d-b902-4d1ee8cebfc3 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:47:16.794559 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5d3b3bff-bdda-465d-b902-4d1ee8cebfc3 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:47:16.824006 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-5d3b3bff-bdda-465d-b902-4d1ee8cebfc3 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Going to try to terminate instance {{(pid=117712) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 06:47:16.844345 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-37722da4-7c02-49c5-9b2e-41e7050d68b3 req-05063f6f-ab60-43b1-abcd-474b4c2ab751 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d3432db-453c-433c-8644-7aef9960fb7b", "tag": "96bc5f89-9dca-4662-8882-eed7169c3f63"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:47:16.853537 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-37722da4-7c02-49c5-9b2e-41e7050d68b3 req-05063f6f-ab60-43b1-abcd-474b4c2ab751 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:47:16.854094 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-37722da4-7c02-49c5-9b2e-41e7050d68b3 req-05063f6f-ab60-43b1-abcd-474b4c2ab751 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:47:16.865537 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-37722da4-7c02-49c5-9b2e-41e7050d68b3 req-05063f6f-ab60-43b1-abcd-474b4c2ab751 service nova] Creating event network-changed:96bc5f89-9dca-4662-8882-eed7169c3f63 for instance 6d3432db-453c-433c-8644-7aef9960fb7b on hv-cinder-83699 May 19 06:47:16.872125 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-37722da4-7c02-49c5-9b2e-41e7050d68b3 req-05063f6f-ab60-43b1-abcd-474b4c2ab751 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103712 May 19 06:47:16.872949 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 509/1018] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:47:16.925259 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-5d3b3bff-bdda-465d-b902-4d1ee8cebfc3 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 204 len: 0 microversion: 2.1 time: 0.162131 May 19 06:47:16.925881 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 510/1019] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 06:47:16 2022] DELETE /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 06:47:16.935184 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ce386dd7-eb58-4de1-8bc1-a1bfd74f5afb tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:47:16.936226 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ce386dd7-eb58-4de1-8bc1-a1bfd74f5afb tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:47:16.942796 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ce386dd7-eb58-4de1-8bc1-a1bfd74f5afb tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:47:16.943552 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ce386dd7-eb58-4de1-8bc1-a1bfd74f5afb tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:47:16.944553 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ce386dd7-eb58-4de1-8bc1-a1bfd74f5afb tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:47:16.945806 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ce386dd7-eb58-4de1-8bc1-a1bfd74f5afb tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:47:17.080478 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ce386dd7-eb58-4de1-8bc1-a1bfd74f5afb tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:47:17.089244 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ce386dd7-eb58-4de1-8bc1-a1bfd74f5afb tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1570 microversion: 2.1 time: 0.158176 May 19 06:47:17.089870 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 510/1020] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:47:16 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:47:18.108233 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d8aec8ee-4257-4cba-adc3-97e69e202b46 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:47:18.108930 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d8aec8ee-4257-4cba-adc3-97e69e202b46 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:47:18.119068 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO oslo.messaging._drivers.impl_rabbit [-] [583768b3-8e89-45f3-ba07-83e67e9b2b80] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 43434. May 19 06:47:18.122951 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d8aec8ee-4257-4cba-adc3-97e69e202b46 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:47:18.123454 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d8aec8ee-4257-4cba-adc3-97e69e202b46 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:47:18.124233 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d8aec8ee-4257-4cba-adc3-97e69e202b46 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:47:18.124675 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d8aec8ee-4257-4cba-adc3-97e69e202b46 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:47:18.257340 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d8aec8ee-4257-4cba-adc3-97e69e202b46 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:47:18.264817 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d8aec8ee-4257-4cba-adc3-97e69e202b46 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1570 microversion: 2.1 time: 0.160877 May 19 06:47:18.265392 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 511/1021] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:47:18 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:47:19.264610 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-231321bb-f950-4e55-bc50-9068761c36c3 req-57858078-577a-4d41-b1bb-35d300aa4982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d3432db-453c-433c-8644-7aef9960fb7b", "name": "network-vif-deleted", "tag": "96bc5f89-9dca-4662-8882-eed7169c3f63"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:47:19.273217 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-231321bb-f950-4e55-bc50-9068761c36c3 req-57858078-577a-4d41-b1bb-35d300aa4982 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:47:19.274907 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-231321bb-f950-4e55-bc50-9068761c36c3 req-57858078-577a-4d41-b1bb-35d300aa4982 service nova] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:47:19.283230 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-707fa9e0-24b2-4265-9fed-c20ae0da7d5c tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:47:19.284027 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-707fa9e0-24b2-4265-9fed-c20ae0da7d5c tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:47:19.287356 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-231321bb-f950-4e55-bc50-9068761c36c3 req-57858078-577a-4d41-b1bb-35d300aa4982 service nova] Creating event network-vif-deleted:96bc5f89-9dca-4662-8882-eed7169c3f63 for instance 6d3432db-453c-433c-8644-7aef9960fb7b on hv-cinder-83699 May 19 06:47:19.293085 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-231321bb-f950-4e55-bc50-9068761c36c3 req-57858078-577a-4d41-b1bb-35d300aa4982 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032182 May 19 06:47:19.293324 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-707fa9e0-24b2-4265-9fed-c20ae0da7d5c tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:47:19.293644 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-707fa9e0-24b2-4265-9fed-c20ae0da7d5c tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:47:19.293770 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 511/1022] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 06:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:47:19.294388 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-707fa9e0-24b2-4265-9fed-c20ae0da7d5c tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:47:19.294822 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-707fa9e0-24b2-4265-9fed-c20ae0da7d5c tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:47:19.361753 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-707fa9e0-24b2-4265-9fed-c20ae0da7d5c tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697d433699cc475d91609e010917ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acaeb032d8e44eb97a4b0a573e7c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:47:19.369452 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-707fa9e0-24b2-4265-9fed-c20ae0da7d5c tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 200 len: 1220 microversion: 2.1 time: 0.090520 May 19 06:47:19.369884 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 512/1023] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:47:19 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:47:20.387725 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c5270218-96f3-4100-b6e8-c5a05873f06e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:47:20.388427 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c5270218-96f3-4100-b6e8-c5a05873f06e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] [instance: 6d3432db-453c-433c-8644-7aef9960fb7b] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:47:20.394645 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c5270218-96f3-4100-b6e8-c5a05873f06e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:47:20.395099 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c5270218-96f3-4100-b6e8-c5a05873f06e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:47:20.395895 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c5270218-96f3-4100-b6e8-c5a05873f06e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:47:20.396336 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c5270218-96f3-4100-b6e8-c5a05873f06e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Lock "3c468ea9-4daa-4cd8-93b7-4e256fd82cc9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:47:20.411214 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-c5270218-96f3-4100-b6e8-c5a05873f06e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] HTTP exception thrown: Instance 6d3432db-453c-433c-8644-7aef9960fb7b could not be found. May 19 06:47:20.412874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c5270218-96f3-4100-b6e8-c5a05873f06e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Request method failure captured: May 19 06:47:20.412874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b HTTP/1.1 May 19 06:47:20.412874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept: application/json May 19 06:47:20.412874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity May 19 06:47:20.412874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Connection: close May 19 06:47:20.412874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Length: 0 May 19 06:47:20.412874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Content-Type: application/json May 19 06:47:20.412874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Host: 10.222.0.65 May 19 06:47:20.412874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None May 19 06:47:20.412874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 May 19 06:47:20.412874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiheb3JLdfIwFomkhCJGyVP3VpEKkaBwKvn76J4syy70r4k6NI1kbPnlcwQfZ3vZ4gwUWbhPIYeCSv_2lCMXc45FuosYFLB3YdbrQeI2q7cWbiQU5KeyaXF9dR3h1A9aVjBOFNwRPgHZUZfFthX9GZj7If2fzs0tqafZzS-rG4d9FtL9A May 19 06:47:20.412874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Id: None May 19 06:47:20.412874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Domain-Name: None May 19 06:47:20.412874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed May 19 06:47:20.412874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True May 19 06:47:20.412874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default May 19 06:47:20.412874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default May 19 06:47:20.412874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Id: 4acaeb032d8e44eb97a4b0a573e7c360 May 19 06:47:20.412874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-TestShelveInstance-1908940456 May 19 06:47:20.412874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Role: reader,member May 19 06:47:20.412874 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Roles: reader,member May 19 06:47:20.415418 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4acaeb032d8e44eb97a4b0a573e7c360"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4acaeb032d8e44eb97a4b0a573e7c360"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4acaeb032d8e44eb97a4b0a573e7c360"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4acaeb032d8e44eb97a4b0a573e7c360", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] May 19 06:47:20.415418 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-TestShelveInstance-1908940456 May 19 06:47:20.415418 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Id: 4acaeb032d8e44eb97a4b0a573e7c360 May 19 06:47:20.415418 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-TestShelveInstance-1908940456 May 19 06:47:20.415418 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User: tempest-TestShelveInstance-1908940456-project May 19 06:47:20.415418 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default May 19 06:47:20.415418 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default May 19 06:47:20.415418 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Id: 697d433699cc475d91609e010917ca16 May 19 06:47:20.415418 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-TestShelveInstance-1908940456-project May 19 06:47:20.415418 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: method: > May 19 06:47:20.415418 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: exception: Instance 6d3432db-453c-433c-8644-7aef9960fb7b could not be found. May 19 06:47:20.415418 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: action_args: {'id': '6d3432db-453c-433c-8644-7aef9960fb7b'} May 19 06:47:20.416522 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:47:20.416522 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:47:20.416522 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:47:20.416522 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:47:20.416522 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:47:20.416522 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:47:20.416522 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:47:20.416522 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:47:20.416522 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:47:20.416522 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:47:20.416522 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d3432db-453c-433c-8644-7aef9960fb7b could not be found. May 19 06:47:20.416522 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:47:20.416522 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:47:20.416522 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:47:20.416522 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:47:20.416522 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:47:20.416522 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:47:20.416522 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:47:20.416522 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:47:20.416522 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:47:20.418247 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:47:20.418247 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 06:47:20.418247 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:47:20.418247 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 06:47:20.418247 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:47:20.418247 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:47:20.418247 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:47:20.418247 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d3432db-453c-433c-8644-7aef9960fb7b could not be found. May 19 06:47:20.418247 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:47:20.418247 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:47:20.418247 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:47:20.418247 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:47:20.418247 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:47:20.418247 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:47:20.418247 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:47:20.418247 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:47:20.418247 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d3432db-453c-433c-8644-7aef9960fb7b could not be found. May 19 06:47:20.418247 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi May 19 06:47:20.419725 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c5270218-96f3-4100-b6e8-c5a05873f06e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Returning 404 to user: Instance 6d3432db-453c-433c-8644-7aef9960fb7b could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:47:20.419725 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c5270218-96f3-4100-b6e8-c5a05873f06e tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b" status: 404 len: 111 microversion: 2.1 time: 0.031706 May 19 06:47:20.419725 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 512/1024] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 06:47:20 2022] GET /compute/v2.1/servers/6d3432db-453c-433c-8644-7aef9960fb7b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:47:20.578241 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-522de816-0088-4f27-a79b-6baeb53b2af9 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] Calling method '.version_select at 0x7f9aeaf09b80>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:47:20.600567 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-522de816-0088-4f27-a79b-6baeb53b2af9 tempest-TestShelveInstance-1908940456 tempest-TestShelveInstance-1908940456-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1779094856" status: 202 len: 0 microversion: 2.1 time: 0.026659 May 19 06:47:20.601331 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 513/1025] 10.222.0.65 () {58 vars in 1253 bytes} [Thu May 19 06:47:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1779094856 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 06:49:01.120836 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 06:49:01.121620 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Thu May 19 06:49:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 06:49:30.023483 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 06:49:30.024068 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Thu May 19 06:49:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 06:49:48.430773 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 06:49:48.431398 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Thu May 19 06:49:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 06:51:20.788783 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 06:51:20.789502 dv-cinder-836996-22-iscsi devstack@n-api.service[117712]: Thu May 19 06:51:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 06:52:21.129901 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 06:52:21.130525 dv-cinder-836996-22-iscsi devstack@n-api.service[117711]: Thu May 19 06:52:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!